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A CONCEPT ATTAINMENT TASK IN WHICH CHILDREN ARE ASKED TO 
IDENTIFY A CONCEPT THROUGH DETERMINING WHICH OF A SET OF 
OBJECTS ARE OR ARE NOT INSTANCES OF IT WAS USED TO 
INVESTIGATE THEIR PROBLEM-SOLVING BEHAVIOR. OF PARTICULAR 
INTEREST WAS THE QUESTION OF TO WHAT EXTENT THEY USED OR 
LEARNED THE STRATEGY OF VARYING ONE FACTOR WHILE HOLDING ALL 
OTHERS CONSTANT. IN THE FIRST OF THREE EXPERIMENTS A SAMPLE 
OF 144 FOURTH GRADERS WERE GIVEN 24 APTITUDE TESTS AND NINE 
CONCEPT ATTAINMENT TASKS. OF SEVEN APTITUDE FACTORS FOUND, 

ONLY TWO, CALLED SPATIAL ORIENTATION AND FIGURAL ADAPTIVE 
FLEXIBILITY, SHOWED SIGNIFICANT CORRELATIONS WITH 
PROBLEM-SOLVING PERFORMANCE. THE SECOND EXPERIMENT 
INVESTIGATED THE EFFECT OF THE PRESENCE OR ABSENCE OF ACTUAL 
OBJECTS ON CHILDREN'S PERFORMANCE. A SAMPLE OF 24 THIRD OR 
FOURTH GRADERS WERE EACH GIVEN THREE PROBLEMS TO SOLVE. OF 
FOUR GROUPS, ONLY THE ONE NEVER SHOWN ANY OBJECTS PERFORMED 
SIGNIFICANTLY MORE POORLY. THE THIRD EXPERIMENT WAS INTENDED 
TO COMPARE TWO METHODS OF TEACHING THE DESIRED 
PROBLEM-SOLVING STRATEGY, A PART-TASK METHOD WHICH ATTEMPTED 
TO TEACH COMPONENT SKILLS AND A WHOLE-TASK METHOD WHICH 
ATTEMPTED TO TEACH THE TOTAL SKILL. TWO GROUPS OF 18 FIRST 
GRADERS RECEIVED ONE OR THE OTHER FORM OF TRAINING, AFTER 
WHICH THEIR PERFORMANCE WAS COMPARED WITH A GROUP OF 
UNTRAINED FIRST GRADERS. ON RETENTION PROBLEMS THE PART-TASK 
GROUP WAS SIGNIFICANTLY BETTER THAN THE WHOLE-TASK GROUP, 

WHICH WAS IN TURN BETTER THAN THE UNTRAINED GROUP. (DR) 
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CHABTBR X 

An Analysis of a Concapt Attainment Task 



H 

Most of the research described in these pages involved a single kind 
of problem. The subject—a first, second, third, or fourth grader-^was 
confronted with an instance of a phenomenon. His task was to discover the 
necessary and sufficient conditions for the occurrence of the i^enonenon. 
This he did by making a series of observations, or experimental tests, in 
which he varied features of the situation to determine which were associated 
with the presence of the phenomenon and which were not. When he was satis* 
fled that he knew, he described the necessary and sufficient conditions in 
words. The kind of task which has Just been described is often called a 
concept attainment problem. In this language it is said that the stdiject 
is shown a positive or "focus " instance; that he selects Instances; 
receives feedback as to whether, the. instances are positive (show the 
concept) or negative (do not show the concept); and, as soon as he can, 
names the concept. 



Description of the class of problems 

A concrete example «iill serve to illustrate the t]rpe of problem pre- 
sented to the child and the sort of behavior expected from him. The 
materials consisted of eight 2-1/2 X 3-1/4 in. cards taped in an orderly 
arrangement on a 16 X 18 in. Masonite panel. The cards had figures 
Inscribed upon them that varied with respect to nusiber (one figure or two 
figures), color (red or green) and form (box or diamond), fig. 1.1 
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Red outline 

Green outline 

Pig. 1.1. The card array. 
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contains a representation of the card array. The coded description of 
each card (e.g. IRD, 26B) was not Included In the materials the child saw. 
The following instructions were read to the child: 



I will think of a secret and point to one card that shows 
my secret. You pick cards to figure out my secret. Each time 
you pick a card I will tell you whether or not it shows the 
secret. As soon as you are sure you know, tell me the secret. 



The "secret" was one of the 27 different concepts which can be 
formed with the card array (and the other materials described later), 
disallowing relational and disjunctive concepts. There is one O-dimenslonal 
concept (all the cards) and there are six l-^dimenslonal concepts, twelve 
2*dimensional concepts, and eight 3*^imensional concepts. The 27 possible 
concepts and the positive instances of each are listed in Fig. 1.2. 

The problem might Involve any one of the 27 possible concepts. In 
no case did the child know which aspects nor how many aspects of the 
stimulus were discriminative. He began only with a positive or "focus" 
Instance. It was not enough that the child say the "right answer." Tc 
be counted as having solved the problem, the child had to choose a set of 
cards and state a concept such that the set of cards logically implied the 



concept he stated and no other. 

Compare the following two protocols. The only difference between them 
is with respect to event #4. 



Child A 



1. The experimenter reads instructions then points to IRD indicating 
that it "shows the secret." 



2. The child points to 16D. 



3. The experimenter says "No, that (indicating IGD) does not^ show 
my secret." 
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Concent name 



All the Cards 

One 

Two 

Red 

Green 

Box 

Diamond 

One Red 
One Green 
One Box 
One Diamond 
Two Red 
Two Green 
Two Box 
Two Diamond 
Red Box 
Red Diamond 
Green Box 
Green Diamond 

One Red Box 
One Red Diamond 
One Green Box 
One Green Diamond 
Two Red Box 
TWo Red Diamond 
Two Green Box 

Green Diamond 



4 



Positive instances 



All the Cards 



1RB» 


IRD, 


1G13, 


IGD 


2RB, 


2RD, 


2GB, 


2GD 


IRB, 


IRD, 


2RB, 


2RD 


1GB y 


IGD, 


2GB, 


2GD 


IRB, 


1GB, 


2RB, 


2GB 


IRD, 


IGD, 


2RD, 


2GD 




IRB, 


IRD 






1GB, 


IGD 






IRB, 


1GB 






IRD, 


IGD 






2RB, 


2RD 






2GB, 


2GD 






2RB, 


2GB 






2RD, 


2GD 






IRB, 


2RB 






IRD, 


2RD 






1GB, 


2GB 






16D, 


2GD 






IRB 






IRD 






1GB 






IGD 






2RB 






2RD 






2GB 






2GD 





Fig. 1.2. Possible concepts with the card array materials 
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4. The child points to 16B. 

5. The experimenter says "No, •••" 

6. The child points to 2RD. 

7. The experimenter says "Yes, •••" 

8. The child says "The secret is Red Diamond." 

Child B 

1. The experimenter reads instructions then points to IRD indicating 
that it "shows the secret." 

2. The child points to 16D. 

3. The experimenter says "No, that (indicating 16D) does not show ray 
secret." 

4. The child points to IRB. 

5. The experimenter says "No, ..." 

6. The child points to 2RD. 

7. The experimenter says "Yes, ..." 

8. The child says "The secret is Red Diamond." 






Child B has solved the problem, that is, he has completed a series of 
observations which can be taken to prove that the concept is Red Diamond. 
Child A stated the correct concept, but the observations he made did not 
logically eliminate the possibility that the concept was Red. 

Rationale for the study of a class of problems 

Generic definitions of problem solving are valueless since problem 
solving is a family resemblance term. There are several reasonable and 
customary usages of the term and a variety of tasks which are called 
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problems. For this reason there will be no attempt to Justify the task 
chosen for Intensive study In the present experiments by appeal to pur-* 
portedly generic definitions of problem solving. 

Rather, the defense Is that the task described on the preceding pages 
Is a representative of a peculiarly Important class of tasks. The task 
entails a pattern of Inductive Inquiry that has been Important In the rise 
of modern science and also plays a role In such practical problem solving 
as medical diagnosis and the trouble shooting of malfunctions In complex 
equipment. Bruner, Goodnow, and Austin (1956), whose provocative book 
L Study of Thinking laid the groundwork for the analysis of concept 
attainment, employed the case of a neurologist Interested In pattern vision 
In the monkey to Illustrate the parallel between Inductive Inquiry In 
science and a task such as a card array problem. "More specifically, 

[the neurologist] Is Interested In six cortical areas and their bearing 
on pattern vision. He knows that, with all six areas intact, pattern 
vision is absent. His tecfmlque of research Is extirpation. In planning 
his research, how shall he proceed? Destroy one area at a time? All but 
one at a time? In what order shall he do his successive experimenta?** 

(p. 81) 

Suppose the neurologist destroys five of the six cortical areas and 
finds that pattern vision is absent. This experiment has proved exactly 
nothing. The neurologist knows that one or more of the cortical areas 
Is essential for pattern vision, but he knew that to begin with. Suppose, 
on tTae other hand, the five cortical areas were extirpated and pattern 
vision were unimpaired. If this were the case, the problem would be solved 
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in one fell swoop. The remaining area must be the one and only area 
necessary for pattern vision (provided it is not true that one or another 
of several areas can maintain adequate pattern vision; in other words 
that pattern vision is absent only when each involved area is destroyed). 

An alternative strategy is to extirpate one cortical area. If, as 
a consequence, pattern vision is absent, the experiment has proved that 
the involved cortical area is essential. If pattern vision is unimpaired, 
then the area which was extirpated is Irrelevant to pattern vision. 

Unlike the strategy of destroying five areas at once, the strategy of 
destroying just one guarantees that useful information will be obtained 
regardless of the outcome of the experiment. On the other hand, it would 
be impossible to solve the whole problem with just one experiment using 
the latter strategy. 

Bruner and his associates have made much of "risk regulation" as a 
function served by a problem solving strategy. In the process they have 
underestimated the risk of loss of information Involved in a "gambling 
strategy." While the neurologist who destroyed five areas of the cortex 
might be lucky enough to discover the one cortical area essential for pattern 
vision, then again he might not be. So long as in reality exactly one 
cortical area was necessary for pattern vision, the strategy of extir- 
pating some set of five areas at a time would be as efficient— no more, 
no less— as extirpating one at a time. Suppose, however, that two 
Independent cortical areas have to be Intact for pattern vision to 
be present. If this were the case, the problem could never be solved by 



destroying sets of five areas at a time. Pattern vision would always 
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be absent and there would be no way to tell which cortical areas were 
involved. If only four areas were destroyed at a time the same problem 

V 

would arise should it happen that three of the cortical areas were 
necessary for pattern vision. Even supposing that exactly two of the six 
cortical areas were Involved in pattern vision, it would be inefficient 
to locate them by destroying four areas at a time. There are 15 different 
combinations of six things taken two at a time. Nothing will be learned 
from any of the experiments in which pattern vision is absent because 
there will be no way to tell which cortical area is responsible. Thus it 
could take as many as 15 experiments to find the single case in which four 
areas have been destroyed but pattern vision remains Intact. It would take 
six experiments at most to discover the cortical areas that control pattern 
vision using the strategy of extirpating one area at a time and, unlike 
the strategy of destroying several areas at once, this strategy would 
work successfully no matter how many areas were actually involved. 

The notion developed in the preceding paragraphs is that the optimum 
strategy for solving concept attainment problems is to vary or manipulate 
each factor in succession while holding all other factors constant. This, 
of course, is the classical strategy of experimental science. It has 
been called the Method of Difference by John Stuart Mill, who was among 
the first to analyze inductive methods rigorously. Stubbing (1888, p. 

120) wrote the following about the Method of Difference in Analysis of 
Mr . Mill’s System of Logic ; 

”Canon — If an instance in which the phenomenon in question 
occurs and an Instance in \dilch it does not occur have every 
other circumstance in common save one, that one occurring only 
in the former, — that circumstance in which alone the two 
instances differ, is the effect or the cause of a necessary 
part of the cause, of the phenomenon. 
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The principle Is that of comparing an Instance of the 
occurrence of a phenomenon with a similar Insta^ice In which 
it does not occur, to discover In what they differ. 



Remarks ;-- 

!• This method Is more particularly a method of artificial 

experiment (Its ordinary use being to compare the condition 
of things before, with those after, an experiment), 
because— 

2. It Is commonly employed to determine the effects of given 
causes; and because— 

3. The Instances which It requires are rigid and definite— 
they must be exactly alike, except that In one the 
phenomenon must be present and In the other absent* 

4. If this method Is Inapplicable, It Is usually because 
artificial experiment Is impracticable. 

5. It is the only method, of direct experience, by which 
laws of causation can be proved. 

6. If the Instances fulfill exactly the requirements of the 
Canon, this method is perfectly rigorous in Its proof." 



The method of varying each factor in succession while holding all 
other factors constant Is the most efficient strategy there Is for attaining 
concepts. A concept can always be attained using this strategy in exactly 
as many trials (experiments, observations) as there are variables (factors, 
stimulus dimensions) to be processed. Any other strategy will on the 
average (assuming there are no predictable constraints on the nature of 
the concept to be attained) require more trials than there are variables. 

The superior efficiency of the Method of Difference follows from the well- 
known theorem of Information theory that the most efficient Information 
processing procedure Is the one that reduces the set of possible concepts 
by exactly half at each step. The strategy of studying each factor holding 
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all other factors constant is the only strategy for attaining conjunctive 
concepts that reduces the set of possible concepts by exactly half at 
each experiment. Consider the pattern vision illustration. Each of six 
cortical areas either is or is not relevant to pattern vision. Thus, 
there are 2^ combinations, or concepts, each representing the relevance 
of one or more areas and the Irrelevance of the rest. One arc^ is 
extirpated. If pattern vision is impaired the half of the combinations 
which do not involve the extirpated area can be eliminated. On the other 
hand, if pattern vision is Intact, th^. half of the combinations which ^ 
involve the extirpated area can be discounted. In either event, 2 

combinations will remain possible. The next experiment involving the next 

* 4 3 . 

cortical area will reduce the number to 2 , the next to 2 , and so on 

until the problem is solved. As already explained a strategy that entails 

simultaneous variation on more than one factor at a time will sometimes 

reduce the possible concepts by more than half but that more frequently 

less than half will be eliminated and that such a strategy is on the 

average less efficient than the strategy of varying only one factor at a 

time. 

Superficially, the complex designs science frequently employs may 
seem to violate the maxim that simultaneous variation of several factors 
is inefficient. Consider the factorial experiment ot social scientists 
for instance. Here the counterbalancing makes it possible to contrast 



^Actually there are 2^-1 combinations, or concepts, since the case 
in which none of the areas is relevant can be eliminated on the basis 
of the givens of the problem. 
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the levels of a single factor. The counterbalancing is the logical 
equivalent of holding all other factors constant. 

The purpose of this section has been to construct a rationale for 
the intensive study of a kind of problem. The chief argument has been 
that the concept attainment task is a representative of a large and 
socially-important class of problems. Other representatives of the class 
include certain forms of scientific inquiry, medical diagnosis, and trouble 
shooting. Another conclusion is that, despite the inference permitted 
by previous investigators, there is an optimum strategy for the solution 
of concept attainment problems. 

Limits of the analogy between the concept attainment 
task and a, larger class of problems 

Much of the really critica.1 genetic research during the last 
century was completed with sweet peas, fruit flies, and bread mold. These 
organisms were employed — instead of, say, oak trees and elephiints, or 
people-o^lnly because they are convenient to study. It «ms an article 
of faith that the hereditary mechanisms underlying, for instance, the 
presence of curly wings or straight wings in the fruit fly would shed 
light on the genetics of living things in general. 

The concept attainment task is intended as a Drosophila more easy 
to study than other representatives of the class of problems. Thus far the 
attempt has been made to show that the essential logic of a concept 
attainment problem and a problem in scientific inquiry, if not identical, 
have much in common. However, there are differences. 
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The first difference is that the person working at a concept attain- 
ment task begins with a well-defined system whereas defining the system 
to be investigated is the first problem in problem solving more generally. 

The "system" is the set of interacting variables. A system is **well-defined" 
for a person when he can enumerate the potentially relevant variables 
(e.g. list the areas of the cortex that might control pattern vision), 
name the values each variable may take on (e.g. answer the question "What 
are the different colors these cards show?"); find or create the exemplifying 
Instances given the name of any concept (e.g. respond to the request "Find 
the compound, pinate leaves."); name the concept given any complete set 
of exemplifying instances (e.g. answer the question "These cards (IRB, 

IRD) show the secret; what is the secret?"). 

A second difference is that in the concept attainment task, at least 
the form employed in the present research, the instances are physically 
arrayed in front of the subject. In contrast, the scientist who is trying 
to "attain the concept" of the necessary and sufficient conditions for the 
occurrence of a phenomenon seldom has all the possible instances available 
within his visual field from the start. He must create or search out the 
instances. Let us be perfectly clear. An "instance" is the combination 
of one value from each of the factors in the system. A card showing 2RD 
is an instance in a system of cards with figures inscribed upon them that 
vary with respect to form, color, and nusiber. An organism with two speci- 
fied areas of the cortex extirpated and four others intact is an instance 
in a system involving the extirpation or nonextirpation of six cortical 
areas. The pattern vision problem could be made just like the card array 
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problem lf» in advance of checking impairment of vision, each of 64 
organisms were prepared with one of the 64 combinations of destruction and 
nondestruction of the six areas of the cortex* These instances could then 
be arrayed in front of the investigator. Or, the transformation could be 
made the other way around. The card problem could be made like the pattern 
vision problem if the person were given pencils with green and red lead 
and templates for constructing a box or a diamond. 

In the concept attainment task — unlike otherwise similar representa- 
tives of the general class of problems~the instances are physically 
arrayed in front of the problem solver. According to Piaget, this should 
make a difference for children since they are said to be unable to 
"conceive combinatorial possibilities." Translating this into operational 
language, it refers to the behavior of producing or creating instances 
which will meet the logical requirements for problem solution. Anderson 
(1963) found that children who received training did very well on problems 
in which the instances were physically arrayed in front of them but less 
well on problems in which tiie instances had to be created. It would be 
interesting to find out if this occurred because of lack of skill in 
producing instances or for some other reason. Oi:e of the experiments 
reported later investigated this issue. 

A frame of reference 

It is popularly said that people "employ strategies" to solve problems. 
Terms such as "strategy," "plan," "decision," and "hypothesis" are redolent 
of volition, conscious ego control, and awareness. The customary language 
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of those Involved In problem solving research tends to make a person 
visualize problem solving as a series of deliberate decisions of which 
the problem solver is aware v It may be that behavior that is accompanied 
by awareness and a sense of volitional control is different from or even 
more adaptive than other behavior. The evidence seems to indicate, for 
example, that people whose verbal behavior is modified by a social relnforcer 
will later be able to describe the class of responses that was reinforced 
(Splelberger and DeNlke, 1966). Nonetheless, the causal role, if any, 
that is played by "awareness" is obscure. If awareness means anything 
useful it refers to implicit verbal and, perhaps, nonverbal behavior. 

The person "says something to himself." This response has stimulus propertle 
which could in part control subsequent behavior. "Listening to one’s self" 
say something should be approximately equivalent to hearing someone else 
say the same thing. 

It hardly seems inevitable that Implicit verbal and nonverbal 
behavior is of overriding Importance in problem solving. The controlling 
variables may operate directly on publicly observable behavior without 
mediating chains of implicit responses. This is a position which, for 
several reasons, investigators in the area of problem solving are dis- 
inclined to believe. One reason is to be found in the prevailing language 
of discourse. 

It is often said that a subject "applies a rule." Usually such an 
ascription is entirely metaphorical. If a rock is thrown into the air, 
there is a one-to-one correspondence between a set of points in the air 
tha^ mark the flight of the rock and the set of points on a graph that 
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SAtlsfy some equation# It would not be said that the rock was **applylng 
the equation nor that there was a mechanism In the rock programed according 
to the equation# The state of physics being what It Is, these ascriptions 
are not likely to be made# Such ascriptions are made by psychologists and 
educators* especially when the subject of discussion Is problem solving# 

The difficulty lies In the confusion between the literal and metaphorical 

senses of the phrase to "apply a rule#" 

A person Is "applying a rule" only when he completes a specific chain 
of verbal responses# For instance a person faced with the problem below 
could be said to "apply a multiplication algorithm" If he ran off the 
following chain: "four times four Is sixteen (writes 6) — carry one — four 

times one is four* plus one Is five (writes 5 to the left of 6)““four 
times three Is twelve (writes 12 to the left of 5)#" 

314 

X 4 

If no one observed a chain of responses such as this It still might be 
^tnap^np<^ that the person applied this multiplication algorithm# However It 
would be entirely possible that he applied some other algorithm (e#g# 

"four times 300 Is 1200— four times 10 Is 40, 1240— four times 4 Is 16, 
1256")# And It Is possible, though perhaps not likely, that the stimulus 
controlled the response directly, that the person got the answer without 
applying an algorithm# Notice that the larger multiplier consists of the 
first three digits of # Some people have learned the products of 
and single-digit numbers much like they learned the multiplication tables# 
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In other cases it is completely misleading to say that a person is 
"applying a rule." There is, for instance, no useful sense in which a 
baseball outfielder who catches a flyball after a long run can be said to 
be applying the laws of physics. If he were applying laws of physics he 
would be substituting estimated values into equations in order to determine 
the course he should take to Intercept the ball. He does no such thing. 

His behavior is under more direct stimulus control. It is permissible to 
say that the outfielder behaves aa though he were applying rules of physics. 
However the person who allows himself to drop the "as though" runs the 
risk of entering eplstomologlcal quicksand. 

Those who study language seem fascinated by the paradox they have 
created for themselves: children apply rules of grammar yet children 

know no rules of grammar. Indeed, really no one but linguists do. Herein 
lies another cucample of confusion between the literal and metaphorical 
senses of the phrase "to apply a rule." A native speaker of a language 
seldom applies rules of grammar when he utters well-formed sentences in 
ordinary conversation. The same person WL apply grammatical rules some of 
the time when writing a manuscript, and he almost certainly does when he 
later edits the manuscript. 

To the present author’s way of thinking, talk about "strategies," 
the "application of rules," and the "testing of hypotheses" is not objection- 
able primarily because it is speculative or because it refers to purported 
events which are unobservable. The big problem with constructs such as 
strategy is that they beg the most interesting questions. 
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Problem solving behavior can be understood In the following terms. 

The more or less organized sequences or patterns of behavior, popularly 
called strategies, that seem to comprise much problem-solving behavior at 
a molar level of description, are hypothetically under stimulus control 
of two kinds. First, especially on the part of the good problem solver, 
behavior Is under discriminative control of relevant task and problem cues, 
those present at the beginning and, depending upon the kind of problem, 
those cues that emerge during the course of work on the problem. Second, 
problem-solving behavior Is partly controlled by response-produced stimuli. 
Including, perhaps. Intraverbals or other forms of mediation. Relnforcers 
of several kinds— for Instance, we might suppose, what Polya (1954) calls 
"signs of progress"— act to Increase the likelihood of certain forms of 
the behavior that Is emitted during the problem-solving episode. If 
there Is an orderly relationship between the contingencies of reinforcement 
operating during problem solving and the criteria for problem solution, 
then the problem-solving episode Is a sort of microscopic natural-selection 
process. Presumably, three processes— discriminative control of problem- 
solving behavior by task cues, control of behavior by response-produced 
cues, and selection of forms of behavior by reinforcement— are sufficient 
to account for the coordinated, purposeful character of some problem- 
solving behavior that has seemed so salient to many students of problem 
solving. 
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A functlonal-behavlorsi analysis of a problem-solving skill 

A rough distinction will be made between a functional and a behavioral 
analysis. A functional analysis deals with molar processes and skill 
components. The emphasis In a functional analysis Is on the task and on 
the processes which must be assumed In order for the task to be accomplished. 
The behavioral analysis attempts to detail the specific chains of responses 
and Indicate the controlling variables at every step. The analysis will 
begin at a functional level and progress to a behavioral one. 

The person attempting to solve a concept attainment problem will 
engage In two easlly-dlstlngulshable kinds of observable behavior. He 
will select Instances and he will name concepts. In other words he will 
engage In Instance-selection behavior and In concept-naming, or conclusion- 
drawing, behavior. Optimum behavior will entail the selection of as many 
Instances as there are variables In the system and then the statement of 
the concept. There are three variables— form, color, and number— In the 
card array task. Thus, every card array problem can be solved after the 
selection of three Instances. A problem has been solved when the Instances 
selected Imply the concept stated and no other. The question Is what must 
be assumed In order for a person to make an optimum solution to any concept 
attainment problem. While a logical relationship defines the solution of 
a problem, there Is no need to assume that the successful problem solver 
"applies logic." Perhaps he could solve problems by applying logic, but 
he need not. The distinction Intended Is the one developed In the preceding 
section. 
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Let us begin by analysing conclusion-drawing behavior independently 

from instance-selection behavior. Assume that a subject receives the 

following four-card array instances in serial order. The •¥ and - Indicate 

whether the Instance "shows the secret" or not. 

IGbf 

IBM 

2GB- 

IGW- 

These instances imply One and only One. ffhat process has to be assumed in 
order to explain how a person could draw this conclusion^ and the correct 
conclusion from any well-formed set of instances? Perhaps it is unfortunate 
that there is not a single answer to this question. There is an end>arrass- 
ingly large variety of processes that could result in perfect conclusion- 
drawing behavior. 

Of historic Interest is what may be called an "information-theoretic 

model," reminiscent of Hovland (1952). The person makes a list of the 

possible concepts. The list consists of all the combinations that can be 

formed from the values of the initial positive instance. For the above 

example, the list of possible concepts is as follows: 

All the Cards 

One 

Green 

Box 

One Green 
One Box 
Green Box 
One Green Box 

As each new instance appears the person deletes half of the concepts 
in the list. If the new instance is positive, the concepts containing 
the feature which was varied are eliminated. If the new instance is 
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negative, the concepts are deleted that do not name the feature of the 
original positive instance which failed to appear in the new instance. 
Rememher we are talking about conclusion-drawing behavior under the assump- 
tion that somehow an appropriate series of instances is available; other- 
wise, without additional assumptions, the process that has just been 
described would not always lead to a correct solution. 

Tlie informat ion- theoretic model is beyond doubt a poor representation 
of people's conclusion-drawing behavior on concept attainment problems. 

To use the term of Bruner and his associates, the process involves too 
much "cognitive strain." It seems improbable that the neurologist 
enumerates for himself the 64 possible combinations of areas of the cortex 

which could control pattern vision. 

Even if he used a paper and pencil to reduce "cognitive strain" 

the neurologist is unlikely to go to the trouble to list the possible 
concepts, because listing the concepts is probably not a component of 
his problem-solving behavior. A stcond conclusion-drawing process may 
more closely approximate the behavior of the neurologist. After each 
new instance the person draws a partial conclusion. If the new instance 
is positive, the conclusion is that the factor which was varied is 
irrelevant. If the new Instance is negative, the conclusion is that the 
feature of the original positive Instance which failed to appear in the 
new instance is a part of the concept. When the complete series of 
instances has been processed, the partial conclusions are combined to 
give the final conclusion. With the illustrative card array problem this 

process would work as follows: 
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Instances Conclusions 



1GB+ 




1RB+ 


Color Irrelevant 


26B- 


One necessary 


IGIH- 


Form Irrelevant 




One 



This will be called the Method of Difference because it most closely 
resembles the procedure outlined and named by John Stuart Mill. In their 
most self-conscious moments scientists probably can be said to be applying 
the Method of Difference when they work on a concept attainment problem. 

A third approach will be called the *'coiinnon elements" method. The 
conclusion is drawn by naming the elements, or features, which the 
positive Instances have in common. Under this procedure the conclusion is 
not drawn until a complete set of Instances is available. With respect 
to the illustrative set of card Instances, all of the positive cards show 

one; there is no other common feature. Thus the conclusion is One. 

A fine grained analysis of the cosmon elements method will be attempted 

since a training procedure described later was based on this method. 

The conclusion— drawing phase begins when there is a complete. Veil-formed 
set of instances available. The discriminative stimulus (S^> marking this 
state of affairs is a byproduct of the instance-selection process which 
will be described later. In the first phase of the conclusion-drawing 
process the problem solver scans the positive Instances. One of the 
discriminative stimuli (S^s) for the scanning response is whatever cue 
has idcntifivid an Instance as positive. In the case of the card array 
task, the S® consists of the words of the experimenter ("Yes, that shows 
my secret."). Remember that the stimuli arrive serially in time, hence. 
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the will not be temporally proximate to the response It presumably 
controls, and therefore some form of memory for positive Instances will be 
required. The matter of memory will be treated when Instance-selection 
behavior Is considered. The problem solver scans features of the Instances. 
It la assumed that the preproblem history of the problem solver has 
established each feature as a reliable for a naming response. During 
the problem he must get S^s for which features to name. These S^s come 
from the check on whether features are common to all positive Instances. 

The as8umpt‘*.on Is that the problem solver does not simultaneously scan all 
features, that he probably scans them In some serial order. The question 
of what the order Is will be considered when Instance— selection behavior 
Is discussed. Since, by assumption, the final conclusion Is not determined 
at an Instant but Is Instead built up In stages, memory Is once again 
Implicated. Probably the problem solver verbally encodes the parts of the 
conclusion at the moment the S^s for c^ch of them Is available. That Is, 
he says the partial conclusion to himself or outloud; the evokes the 
implicit or explicit verbalization. 

We turn now to an analysis of instance-selection behavior. Each 
Instance selected must have the property that it Is Identical to the focus 
Instance or other positive Instances in every respect save one. The 
entire set of Instances should have the property that each of the stimulus 
dimensions is varied once and only once. The basic process Involved in 
selecting Instances is a compare-and-contrast operation. 
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A discrimination is easier if there is immediately available a standard 
for comparison. Herein lies the reason simultaneous discrimination is 
generally easier than successive discrimination. The person can use the 
positive instance singled out by the experimenter at the beginning of a 
concept attainment problem as a standard of comparison. In the broader 
context the standard of comparison is given by the "definition of the problem" 
("with all six areas intact pattern vision is present, with all six 
destroyed it is absent;" "at 60 mph the front end begins to shake"). The 
technique is to compare each prospective instance with the standard. 

Assume the task involves k stimulus dimensions. The prospective Instance 
is an appropriate one if it is the same as the standard in k~l ways and 
different in the final way. Bruner, Goodnow and Austin (1956) called this 
procedure the "conservative focusing strategy." This is the origin of the 



term "focus instance" for the initial positive Instance identified by the 
experimenter. 

In what order will the stimulus dimensions be varied (manipulated, 
observed)? Logically speaking, order makes no difference. But a first 
instance must be chosen, then a second, and so on until Ic instances have 
been selected. Notice that, whatever the first choice, there is a new 
constraint on the second and later choices. The problem solver must 
avoid varying a dimension already varied at a previous choice. With each 
new choice there are fewer "logical degrees of freedom." The statements 
here about logic refer not to logic which the problem solver is applying, 
but to the logical relationship, from a third party point of view, between 
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the stimulus situation and the problem solver's behavior. Some aspects 
of the choice of behavior are ''free" in the sense that they need not be, 
in fact could not be, determined by the S^s which embody logical constraints 
The "free" aspects of choice are probably controlled by the dlscrlmlnablllty 
and "salience" of the features of the stimulus. There are data on the 
salience of stimulus dimensions from the concept learning literature which 
could be brought to bear to predict order of choice. Unfortunately a 
clean prediction is not possible, since it is not clear whether the most 
salient dimension will be the one the problem solver manipulates first or 
the one he manipulates last. Which it is might depend in complicated ways 
upon the concluslon>dr awing process. 

Somehow or other as he chooses a series of Instances tl.e problem 
solver must keep track of the stimulus dimensions processed and remaining 
to be processed. There are several ways this could be done. Bach of 
them Involves some form of memory. One way is to verbally encode the 
dimensions processed (or dimensions remaining to be processed, or both). 
Before each choice, the problem solver recalls these dimensions. That is, 
he gives himself an implicit or explicit autoclitic, a self~tact of the 
form "I have already tried color." If this is what is going on, the 
completion of each Instance selection cycle must provide the for the 
"review tact." 

Another procedure to keep track of progress through the problem is 
to remember the Instances themselves, or perhaps only the positive 
Instances, depending upon the type of conclusion-drawing process. 






Anderson 

As long as the Instances are physically present this procedure need not 
Involve much verbal encoding, perhaps only the "marking" of each Instance 
In terms of Its spatial position In the array. To find out where he has 
been and where he should go, the problem solver scans the Instances 
(Including the focus Instance) already selected. If the same feature 
appears In every Instance a dimension Is thereby Identified which remains 
to be processed. For Instance assume that cards represented as follows 
have been chosen: 

16B 

IRB 

26B 

These cards all contain boxes, so form Is a dimension which remains to be 
manipulated. The presence of a box in each previous Instance provides 
the for the selection next of an Instance which does not contain boxes. 

There Is a somewhat more elegant procedure for keeping track of progress 
through the problem which does Involve verbal encoding. If \diat was 
called the Method of Difference, or any other procedure which entails 
partial conclusions after each Instance, Is employed, the problem solver 
need only rehearse the partial conclusions (which he will probably need 
to do anyway In order to avoid forgetting them) In order to remind himself 
of the stimulus dimensions already processed. This integrated procedure 
Is more elegant In the same sense that a machine with fewer moving parts 
Is good. It Is more economical of the problem solver's time and less 
prone to failure from forgetting, interference, or faulty discrimination. 
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Thus far several different kinds of conclusion-drawing behavior and 
several different kinds of instance-selection behavior have been described. 
The analysis is by no means exhaustive. There are many variations of the 
procedures described. There are others which were not described and 
undoubtedly still others idiich the author has not thought of. Anyone of 
®a®y processes could produce perfect solutions to any and all concept 
attainment problems. That is to say, there are an indefinite nun^er 
of processes that could produce identical protocols of observable responses 
(instance-selection responses, concept-naming responses) for any concept 
attainment problem, and with the further restriction that each protocol 
constitutes an optimumly efficient solution to the problem. 

Ostensibly much of the research on problem solving has been concerned 
with discovering the processes entialed when people solve one or another 
kind of problem. The "process tracing" study is premised on the naive 
assumption that people exhibit their processes when they solve a problem. 
Exhibited are strings of responses. As the preceding analysis has demon- 
strated, there are many processes which could produce even Identical 
strings of responses. It is not possible directly to see the process that 
causes the string of observable responses to be run off as it is. This 
remark is not made under the assumption that Implicit responses occurring 
within the organism are the really important events. Rather the process 
is to be understood in terms of controlling variables, external as well as, 
perhaps, hypothesized Internal events. 
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Intended here is more than the relatively superficial observation that 
many things are possible and that, therefore, conceptualizations should be 
mistrusted. Not only are different processes logically possible, but it 
seems entirely probable that the process is different for different people 
and, indeed, different for the same person on various occasions. Consider 
a mundane parallel. People have various door-opening responses in their 
repertoires: A person may exert force on the door with his hip, push the 

bottom of the door with his foot, lift a latch with his left hand and 
then pull, or turn a knob in a clockwise motion with his right hand and 
then push, or step on a mat concealing a switch that activates a motor that 
moves the door. While these responses may vary in strength, the details 
of the stimulus situation are more important than response strength in 
determining which behavior sequence will occur. With respect to the concept 
attainment problem, there is every reason to believe that many people — 
especially professional problem solvers such as physicians, auto mechanics, 
scientists, and TV repairmen — have repertoires of alternative behavior 
sequences. To reiterate once again, the differences among these sequences 
can be very subtle, so subtle that a record of the easily-distinguishable 
overt responses will not reveal the differences in the behavior nor in the 
controlling variables. 

The author concludes that there are weak grounds to justify the 
process tracing approach predominant among those who engage in problem 
solving research. This monograph represents a different approach. 

discover the process by which people solve problems 



Instead of attempting to 
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the approach is to teach more or less optimum problem solving behavior. 

This approach is justified on at least two grounds. First it is exercise in 
social engineering of potential practical value* since the skill to be 
arranged is of demonstrable Importance. Second, it may in several ways 
contribute to knowledge about complex processes in general. 
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CHAPTER 2 

Procedures for Presenting and Scoring Problems 

In all of the research reported in this monograph problems were 
administered individually by specially trained experimenters (Bs). 

The nine Es who participated in one or more experiments were research 
assistants who ranged in age from 22 to 45. Five Es were graduate 
students in educational psychology, two were housewives, one was a 
summer undergraduate NSF fellow, and one was a third-year law student 
supplementing his income with part-time work. There were seven women 
and two men. All the Es were college graduates. Only one had had 
extensive experience with children prior to participating in this 
research. 

Each E received 15 or more hours of experience training and pre- 
senting problems to children before participating in an experiment. The 
author monitored one or two hours of each E*s preexperlmental performance. 

Problems (and/or training) were presented in such reasonably private 
and distraction-free spaces as the cooperating schools were able to 
provide. These included nurses' offices, storage closets, corridors, a 
kitchen, an auditorium stage, widely separated stations in cafeteria and 
gymnasia, and in one instance a janitor's closet. 

The research entailed three sets of materials. The card array was 
described in detail in Chapter 1. The other two sets of materials were 
the cowboy game and the pencil collection. While the three sets of 
materials involved different stimulus dimensions and different "story 
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lines" were employed with them, an identical problem solving task comld 
be created with each set of materials* It is the task detailed with 

respect to the card array in Chapter I. 

The cowboy game consisted of eight plastic cowboys and accessories 
Imbedded in an orderly arranganent in a 12 X 13 in. plaster of Paris 
base. The game was placed on a table such that the cowboys faced the 
child. The cowboys were either standing or riding horses, either wearing 
a hat or bareheaded, and either carrying a gun (rifle) or not. These 
characteristics were coded as follows: 

Characteristic Code 

Riding 

Standing S 

Gun G 

No gun N 

Hat H 

Bareheaded B 

An Instance can be described by listing the appropriate codes. For 
instance RNB refers to a cov^boy riding a horse who has neither a gun 
nor a hat. A schematic representation of the cowboy game appears in 

Pig. 2.1. 

A story line was employed with the cowboys. The E said: 

In this game you*ve got to figure out which kind of cowboy 
is a friend of the sheriff. I will point to one cowboy who is 
a friend of the sheriff. You point to other cowboys. Each 
time you point to a cowboy, I will tell you whether he is a 
friend of the sheriff. As soon as you are sure you know, 
tell me which kind of cowboy is a friend of the sheriff. 
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R6H 


RNH 


SGH 


SNH 


RGB 


RNB 


SGB 


SNB 



A 



Child 



Fig. 2.1. Schematic representation of the cowboy game. 
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The final set of materials consisted of eight, hexonanal No. 2 
pencils. The pencils displayed three attributes: length (6 or 2 in.), 

presence or absence of eraser, and sharpened or unsharpened. These 
features were coded as follows: 



An Instance can be described with these codes. For example SUE 
stands for a short, unsharpened pencix with an eraser. The pencils were 



placed in a disorderly fashion on a table in front of the child 
each problem, ^ shuffled the pencils. In all but one experimen 
described in later chapters, the child was allowed to handle th 



during the course of a problem, for Instance, to sort them into 
At the beginning of every experimental session in which pr 
were presented, the child first solved a series of simpler prob 
designed to provide warmup, to furnish a high initial frequency 
reinforcement, and to make sure that the concepts the child wou 
subsequently have to attain were in his repertoire. In this or 
exercise, the JB named concepts while the child pointed to all o 
positive instances of the concept. For Instance, if ^ were to 
”The secret is long pencils with no erasers," the child would b 
to point to LUN and LPN. The concepts treated in this manner a 



Characteristic 



Code 



Long 

Short 



L 

S 



Sharpened (point) 
Unsharpened 



P 

U 



Eraser 
No eraser 



E 

N 
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Included the ones which would have to be attalncid in order to solve 
problems later in the session as well as fillers. If the child made an 
error, either of omission or commission, he was prompted to make the 
correct response and, in addition, any item upon which an error occurred 
was repeated after an interval until the child made an unprompted 
correct response. 



Administration of the problem 

The E*s task was to provide the orientation exercise described 
above, to read the instructions (or quote them verbatim without reading), 
to Indicate the focus instance, to give the child feedback as to whether 
each inst«ance selected was positive or negative, to respond with a 
standardized remark to one or another contingency which might arise 
during the course of the problem, to write a protocol of the problem, and 
to determine when the problem should be terminated and either the next 
problem begun or the session terminated. 

If the chi3.d stopped trying to solve the problem, the ^ attempted 
to keep him going with one of a series of "motivational prompts." 
Specifically, if the child made no task-relevant responses for a period 
of 10-15 sec., the E said "Wliat are you going to do now?" If 10-15 
sec. more elapsed in which there were still no task— relevant responses, 
the E t*ien said "See if you can figure out my secret by picking more 
(cards, pencils, cowboys)." l-Ihen this failed to work, the E exhorted 
the child to continue using t/hatever language he believed appropriate. 
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If the child stated an incorrect conclusion with which he was apparently 
satisfied, the E attempted to elicit further progress with a "challeiige 
prompt." The first challenge prompt was, "Are you sure that's my 
secret?" If the child insisted that he was sure or did nothing for 
10-15 sec., the E then said, "Maybe that's not my secret." Finally, 
if the child still persisted, the E usually said, "Maybe the secret 
could be something else. Try to find out for sure what the secret is by 
picking more. .. (cards, pencils, cowboys)." Other wordings were provided 
for special contingencies. When the child accumulated enough informa- 
tion logically to solve the problem but did not volunteer a conclusion, 
the E said "As soon as you are sure you know, tell me the secret." When 
the child seemed to be trying to communicate the concept by pointing out 
the set of positive instances, the E said "Try to say the secret in words 
instead of pointing." The language of all the prompts and the con« 
tlngencies for their use were prescribed. The ^s were permitted no 
unstandardized remarks. A summary of the allowable experimenter state- 
ments appears in Fig. 2.2. 

There was a three-fold stopping rule. The problem was terminated 
(1) if the child solved the problem, that is, if he selected a set of 
instances and stated a concept such that the instances implied the 
concept and no other; (2) if the child refused to continue despite 
allowable experimenter prompts; or (3) if the child selected six 
instances without solving the problem. If the child selected six 
instances without solving the problem but had enough information to 
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Category 


Code 


Statement^ 


Kotlvatlonal prompts 


Slight motivational prompt 


Ml 


"What are you going to do now?" 


Moderate motivational prompt 


M2 


"See If you can figure out 
my secret." 


Strong motivational prompt 


M3 


Encourage the child to continue 
In your own words. 


Challenge prompts 


Slight challenge prompt 


PI 


"Are you sure that's my secret?" 


Moderate challenge prompt 


P2 


"Maybe that's not my secret." 


Strong challenge prompt 


P3 


"That ' s not my secret . Try to 
figure out my secret by..." 
or 

"Maybe the secret could be 
something else. Try to find 
out for sure what the secret 
Is by. . ." 

or 

"That's not the secret. We 
don't have secrets like that 
In this game. It's one of the 
secrets we had In the first 
game. Try to figure out the 
secret by..." 


Eliciting prompts 


Slight eliciting prompt 




"As soon as you are sure you 
know, tell me the secret." 


Strong eliciting prompt 


=2 


"I can't let you pick any more 
. . . Can you tell me the 
secret now?" 


Special categories 


Refuses to continue 


Refuses 

to 

continue 




Put In words 


PW 


"Try to say the secret In 
words Instead of pointing." 


^In the case of cowboy problems, the 


statements should read "the 


kind of cowboy who Is a friend of the sheriff*' In place of *my secret. 




Fig. 2.2. Allowable experimenter statements. 
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do so, the E said "I can't let you pick any more. .. (cards, pencils, 
cowboys). Can you tell me the secret now?" The ^s were Instructed to 
continue the problem when they were not sure whether a child had solved 
a problem, since, should It happen that the child had solved the problem, 
the extraneous portion of the record could be eliminated. 

The E wrote a protocol for each problem. Indicating the concept 
and focus Instance and recording In coded form the Instances the child 
selected, the statements the child made, and the statements £ made In 
the sequence in which these events occurred. Figs. 2.3A and 2.3B contain 
sample protocols. The numbered entries represent Instances the child 
selected. The 4* or ~ Indicates whether the Instance "showed the secret" 
or not. Entries preceded by a V (for verbalization) represent the 
child's concept naming behavior. All other entries represent the behavior 
of E as per Fig. 2.2. 

The dots under the focus Instance code are a form of bookkeeping 
to help E keep track of what the child has proved or failed to prove so 
that jS will know when the problem can be terminated and when eliciting 
prompts should be given. Nonetheless, there Is a minor experimenter 
error evidenced by the protocol In Fig. 2.3B. The slight eliciting 
prompt (El) should have been given after the third Instance rather than 
the fourth. No doubt the E was fooled by the third Instance which, 
through logically a poor choice, happened In this case to eliminate both 
presence or absence of an eraser and presence or absence of a sharp 
point from consideration. 
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H|. 2.3A. Sample problem solving protocol lisvelvlng 
the pencil collection. 
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ri|^. 2.3B. Sttspltt problM tolTliis protocol Imrolving 
tho pencil collection. 
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Anderson 

Immediately following a day's administration of problems, the Es 
exchanged protocols to check them for legibility, completeness, accuracy 
of subject and problem Identification, and accuracy of coding. 

Scoring the problem 

The instances selected by a child can be classified Into four 

mutually exclusive and exhaustive categories. They may be inefficient, 

redundant, repetitious, or properly chosen. An inefficient choice is 

so called because on the average it yields less than th^ maximum 

attainable amount of information. Operationally, an inefficient choice 

is an Instance which differs along more than one stimulus dimension 

from the focus instance or other positive instance. A choice Is 

redundant if the outcome, whether the Instance is positive or negative, 

is Implied by previous instances. Redundant choices yield no new 

information. For example, consider the following instances: 

1GE+ 

2GD+ 

1GB+ 

At this point 2GB would be a redundant choice since it must be +. 

Another t a of redundancy can be seen in the following example: 

1RD+ 

1GD+ 

1GB- 

A choice of either 2GB, IRB, or 2RE; would be redundant because previous 
Instances prove that an Instance will be - unless it contains D. In 
short, a choice is redundant (1) if the instance contains an as yet 










untried combination of variables known to be irrelevant and the 



Instance is otherwise the same as a previous positive instance or (2) 
if the instance does not include all of the features previously shown 
to be relevant. 

A repetitious choice exactly duplicates a previous Instance. 

Some redundant choices are also inefficient (e.g. 2GB and 2RB in 
the example above). The distinction between the two categories is 
maintained by the arbitrary convention that an Instance is categorized 



as inefficient only if it is not redundant. 

The analysis of concept naming or conclusion stating behavior 
depends upon the analysis of instance selection behavior. A statement of 
the concept is either valid, consistent, inconsistent, or 'hniscellaneous.’' 
These categories are exhaustive of the unambiguous concept-naming 
behavior of subjects. Only unqualified declarative statements about the 
relevance or irrelevance of variables or unqualified conclusions about 
the concept are categorized. Any nonconjunctive statement is categorized 
as miscellaneous. Otherwise, statements are categorized, as the category 
names suggest, according to whether they are consistent or inconsistent 
with the Instances that have been chosen up to that point. Consistent 
statements are an inappropriate form of verbal behavior since, when 
a statement is scored as consistent, there always remains at least 
one other possible concept. 

When a subject makes a valid statement, he has by definition solved 
the problem; he has stated the one and only correct concept and he 
has selected a set of instances that proves that it is the correct 
concept • 
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Sequence is the essence of this system of content analysis. A 
choice which Is Inefficient at one point might be proper at another and 
redundant or repetitious later. Similarly a statement that Is consistent 
at one point In time might be Inconsistent later while a statement 
which Is valid might only have been consistent at an earlier point. 

The content analysis procedure that has been outlined Is entirely 
objective; there Is no need for subjective "judgement" to classify 
behavior appropriately. Indeed, a computer program was developed to 
score protocols. 

Various indices of the adequacy of problem solving performance 
based on the content analysis are possible. The following overall 
summary index has proved useful: Performance Is summarized on a three 

point scale, a) The £ solves the problem and neither makes any 
Inefficient, redundant, or repetitious choices of Instances nor states 
any Inconsistent, consistent or miscellaneous conclusions (2 points), 
b) The ^ solves the problem but makes one or more inappropriate choice 
or states one or more inappropriate conclusion (1 point) . c) The ^ 
fails to solve the problem (0 points). Other performance measures 
were also employed and these will be described as the occasion demands. 

There are several advantages to computer processing. In previous 
research (Anderson, 1964, 1965) protocols were scored by human raters. 
This Is a rather difficult task. People make mistakes. While Inter** 
rater reliability coefficients have been quite high, around .90 
(Anderson, 1965, p. 81), this means there is only 80 percent "true 
scorj" variance. Computer processing should reduce noise from this 
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source to zero. Second, a number of hours of training is required 
before a person can score proficiently. Third, the scoring of the 
protocols is a laborious, time consuming task. After warmup, a proficient 
rater can score a problem in 5 min. The card-input IBM 1620 computer 
with disk file upon which the content analysis was completed scored a 
protocol in about 3 sec. The research reported herein involved over 2,500 
protocols, counting neither protocols collected in the course of the 
development of training procedures nor the training of Es. Thus, a 
considerable saving in time was realized. (At least, the computer 
programer's time was returned with a dividend.) Fourth, computer processing 
obviated the necessity for two manual transformations of the data and 
manual adding of category totals, both operations in which errors could 
be introduced. The human rater makes a score sheet for each protocol. 

Then he makes a summary ledger sheet. If the analysis is large or 
complex, cards are punched from the ledger sheets. If computer processing 
is employed, the keypuncher works directly from the protocol. Note 
that the keypuncher need not make any substantive decisions. Finally, 
it was possible using the computer to detect and eliminate errors 

Introduced by the jS or the keypuncher. 

An elaborate series of checks was included within the content 
analysis program. Th. accuracy of the concept and focus Instance codes 
was externally verified. From this point on. the computer served as 
its own proofreader. Each line of the protocol was checked against 
the concept. When an Impossible case was detected the computer printed 
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subject and problem Identification and then a message of the form 
"Trial X (meaning Instance) was miscoded by the experimenter or the 
keypuncher*" These cases were manually checked, the error was corrected, 
and then they were resubmitted to the computer. The computer also 
checked to see whether the stopping rules were observed. The computer 
classified cases in which the stopping rules were violated in an 
"illegal termination" category. These cases were manually checked, 
corrected, and resubmitted. Finally, all of the problems in which the 
"right answer" was stated but the problem was not solved were manually 
checked. 

One experiment, to be described in detail later. Involved 848 
protocols. On the first pass through the machine, the computer rejected 
21 protocols, or about 2.5% of the total. A keypunch error had been 
made in 11 cases. In the remaining 10 cases the fault was in the 
protocol; in other words, there was an experimenter error. These 
protocols were examined and a decision was made as to what the codes 
should have been. The smallest change was made in the protocol which 
would make it Internally consistent. Herein lies the only aspect of 
the analysis in which subjective judgement was required. Otherwise 
the analysis was as objective as, say, the scoring of a multiple choice 
test. 

The computer program is printed in Appendix 1. 
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CHAPTER 3 



Individual Differences and Problem Solving 



1 



This chapter will approach problem-solving from the perspective of 
the psychologist » especially the applied psychologist. Interested in 
learning or training* The question to be answered is wbit is there in 
the literature on individual differences, substantive or methodological, 
of worth to the person concerned with developing training procedures that 
facilitate problem-solving performance* Much of the research on prcblem- 
solvlng has been concerned with individual differences, including, for 
example, such factors as rigidity, availability of function, kind of 
strategy employed, and cognitive style* Despite some provocative Ideas 
and data, there are grounds for arguing, as others have argued before 
(e*g*, Duncan, 1959; Schulz, 1960) that as a group ’process-tracing" 
studies of individual differences within the context of problem-solving 
have not led to a substantial corpus of knowledge* Partly for this reason, 
the emphasis will be upon individual differences in problem-solving in 
terms of dimensions established in factor analyses of aptitude tests* 

In what follows, there will be, first, a brief sketch of a theoretical 
orientation toward problem-solving and aptitudes and then, second, a consider* 
ation of several ways in which the research on aptitude factors may bear upon 



Reprinted with the permission of the publisher from Robert M* Ga; 
Editor. Learning and Individual Differences * Columbus, Ohio: Merrill 
Books, 1967, pp* 66-89* 
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Investigations of the learning of complex skills, such as problem-’Solving 
skills. No consideration will be given to such customary topics as increasing 
the precision of experiments by statistically controlling individual 
differences, or selecting persons likely to succeed if presented with 
training. Instead, there will be an attempt to see whether research Involving 
aptitude factors could have value for the development and improvement of 
training procedures. 

Theoretical Orientation 

The author believes that an S*-R orientation offers the most fruitful 
approach to problen-solving. The view outlined in the following passage has 
Bmch in com m on with the conceptions of others with a similar orientation such 
as Cofer (1957), Kendler and xendler (1962), Maltrman (1955, 1960), and 
Skinner (1957). First of all, prdblem-soivlng behavior is not fundamentally 
different from other varieties of behavior. In lhmcan*s (1959, p. 425) 
words, **Prdblem-8olving in hisman adults is a name for a diverse class of 
performances which differs, if it differs at all, only in degree from other 
classes of learning and performance..." The belief is that problem*-solvlng 
behavior, like other kinds of complex behavior, can be conceived most profitably 
in terms of colligations of elemental stimulus-response relationships. 

The mere or less organized sequences or patterns of behavior, popularly 
called "strategies", that seem to comprise much problem-solving behavior, 
at a molar level of description, are hypothetically under stimulus control 
of two kinds. First, especially on tne pert of the good problem-solver. 
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bthavlor is undsr discrlnliimtivs control of rslevsnt task and problem cues^ 
those present at the beginning and, depending upon the kind of problem, 
those cues that emerge during the course of work on the problem. Second, 
problem-solving behavior is partly controlled by response-produced stimuli, 
including, perhaps, intxmverbals or other foims of mediation. Beinforoers 
of several kinds — for instance, we might suppose, what Polya <1964) calls 
**signs of progress*' — act to increase the likelihood of certain forms of 
the behavior that is emitted during tbs problem-solving episode. If it 
happens that there is an orderly relationship between the contingencies 
of reinforcement operating during problem-solving and the criteria for 
problem solution, then the problem-solving episode is a sort of microscopic 
natural selection process. Presumably, the three processes that have been 
listed — discriminative control of problem-solving behavior by task cues, 
control of behavior by response-produced cues, and selection of forms of 
behavior by reinforcement — are sufficient to account for the coordinated, 
purposeful character of some problem-solving behavior that has seemed so 
salient to many students of prdblem-solving. 

Scores on "intelligence" tests can also be given an S-R interpretation; 
however, it is different from the prevailing one. The concept of trait is 
one of the key prevailing ideas underlying the psychology of individual 
differences. Certain tests are said to measure special types of traits 
called aptitudes or abilities. But it is not necessary to infer a trait 
behind a distribution of scores on a test. Nor is one required to believe 
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that the results of factor analytic investigatioiis repfossnt 'Vectors of 
the nind**. Aptitude factors can be regarded as representing independent 
classes of similar or related behavior. Parenthetically, it should be 
recognised that trait psychology plays a large part in the "figurative 
model (Tatsuoka, 1965) that underlies the mathematics of test theory and the 
theory of factor analysis. It would be an interesting and maybe valuable 

exercise to see what sort of individual differences model could be cjnstructed 
on behaviorist assumptions. 

Aptitude Factors and Task Analysis 

Tasks can be described in terms of loadings on reference factors <or 
correlations with either factor scores or univocal reference tests). The 
pattern of leadings indicates the kinds of skills that are important for 
success on the task and indicates their relative importance, possibly 
descriptions in these terms could be useful to the training psychologist 
undertaking a task analysis. Such an approach has often been advocated by 
factor analysts, though, to the author’s knowledge, few if any psychologists 

concerned with training have tried seriously to use the procedure for this 
purpose. 

One of the leading advocates of task analysis by factor analysis, j, p, 
Guilford, and his associates have completed an investigation in the area of 
prdblem-solving that illustrates the method (Merrifield, Guilford, Christensen, 
and Frick, 1962). Three problem-solving tests were invented. These were 
included in a battery composed of reference tests for established factors 
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and new tests to measure hypothetical factors. The results were these: 

No separate problem-solving factor appeared. Bach of the problem-solving 
tests showed a sensible pattern of loadings on established factors. Finally^ 
almost all of the true variance of the problem-solving tests was accounted 
for. The study supported the notion that complex prdblem- solving behavior 
Is not wholly different from simpler behavior, but rather can be analysed 
la terms of more elemental patterns of behavior (though. In this case, 
behavior that is still rather complex). 

A second study from Guilford's laboratory (Frick k Guilford, 1957) 
will be described, since It involves the water-jar problem, a traditional 
favorite. A group version of the water- Jar test was Included In a battery 
of tests that were Intercorrelated and factor analysed. The water- Jar test 
is supposed to measure rlgldity-flexiblllty. As a matter of fact, the test, 
at least the version employed by Frick and Guilford, showed a loading of .42 
on the factor General Reasoning, a loading of .45 on the factor Logical 
Evaluation, but a loading of only .18 on tl^e factor Adaptive Flexibility. 

This Is striking data. Apparently, less than 4% of the variance of the 
water- Jar test is a function of rlgldity-flexiblllty. A person who developed 
a training procedure to facilitate performance on the water-jar test by 
somehow Increasing flexibility or eliciting flexible behavior might well com 
to grief, simply because flexibility Is not very Important for the solution 
of the water- Jar problem. 

Considering the results with the water-jar problem, one cannot help 
wondering whether performance on other popular problems, such as the hatrack 
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problem or the two~8trlng problem. Involves the behaviors each is commonly 
believed to involve. The two-string problem, in particular, has been used 
in a number of training 'Studies, studies notable chiefly for being inconsistent 
with one another (see Maltzman, Belloni, & Fishbein, 1964, p. 6). One of the 
difficulties is that the probl^ is psychometrically inadequate (Ray, 1955; 
Duncan, 1959; Anderson & Anderson, 1963). Could it also be the case that 
the behavior the training procedures have been designed to arrange or evoke 
plays a relatively unimportant role in the solution of the two-string 
problem? Perhaps such a state of affairs would be revealed by an analysis 
of the two-string problem like the analysis Frick and Guilford made of the 
water-jar problem. 

Conry (1965) and Walsh (1963) have studied the relationship between 
aptitude measures and performance on the type of problem-solving task in 
which the subject selects instances until he can name correctly a concept. 

Both investigations empldyed the technique of canonical correlation. The 
present author feels that this technique is inappropriate when the goal is 
to understand the criterion task in terms of stable, meaningful dimensions. 

does the method of including the task to be explained in a factor analysis 
with the reference tests for established factors seem entirely satisfactory 
since then there is a confounding of explanans and explanandum. In any 
event, the Conry (1965) data and the Walsh (1963) data were re-analysed in 
this way: First, the correlations among the aptitude reference tests were 

factored. Then, loadings were obtained for the measures of problem-solving 
performance by extension. 
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Tabtv 3*1 contains the re-anaXysis of Coory'a data, which was dbtained 
front 94 females enrolled in a psychology course. The first factor. General 
Reasoning, is the only one that shows really pronising relationships with 
the problem-solving measures. On the whole, the aptitude factors explain 
disappointingly little of the variance of the prc^lem-solving measures, . 
perhaps for one reason, because the reliabilities of the latter measures 
were low, Conry was not able to obtain estimates of the reliability of 
these measures, but seme indication can be gleaned from the correlations 
between the two iiroblems that were employed. The between-prdb>lems correla- 
tions were .23 and ,41 for time to criterion and cards to criterion, 
respectively. Evidently, the reliability of any of these measures alone is 
rather low. 

The re-analysis of Walsh's (1963) data appears in Tablo 3 . 2* Her study 
was conducted with 53 third graders from a suburban community. The prdblem- 
solving measure is a composite that gives eimel weight to success or failure 
on a problem and an estimate of efficiency involving the instances the child 
selected, Walsh experienced some difficulty with her battery o>f aptitude 
tests. Many of the subtests of the California Test of Mental Maturity 
failed to discriminate well. As a result, these subtests distributed over 
several weak, hard-to-interpret factors. On the other hand, most of the 
sttbtests from the Solving Pussies Test discriminated very well indeed, 
maybe part of the reason why these tended to load highly together on the 
first factor. The one thing the Walsh data does suggest is that Originality 
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my h& a factor ia t!ie perfomaaca of chlldrea on th» kind of pi &i r» i 
^bich tlio atifsjoet aolocta Inataacaa uatil lia caa aano a coacopt«, 

Having now raviowad tona of tlm data tsoaring upon tha .^actiii* atr'iclaro 
of probiota«>8olvi»g tasks^ let us taka a cloaar look a^ tba quastion of tlm 
vaiua^ to tlio paychoiogist intorostad in developing a training procedure^ 
of a deac^,iption of a task in terms of loadings on reiference factors* Of 
cour^^ one could not get very far ty merely pondering tlie names of tlie 
factors witn wbicli a task is saturated* An intimate acquaintance with the 
skills involved in performance on the tests that define a factor is surely 
a pre*requisite for making much sense of a task in terms of factor loadings* 
Stilly even with this proviso^ the result of such analysis is likely to he a 
recipe of the form^ for instance* two parts Verbal Comprehension, one part 
General ksasoning, a dash of ideational FMiency, and a pinch of Semantio 
Spontaneous Fles:ibility,, 

Description in terns of factor loadings seems to provide a sort of 
taxottoaic task analysis* But it does not tell how to put the ingredients 
in the recipe together in order to get a desired, complex skilly the 
training psychologist needs a functi^al task analysis that deals with 
intratask relationships among opponent skills and the order in which 
cemponent skills are to he performed* 

thus far the presumption has been that an adequate factor analytic 
investigation can at least give, at its own peculiar level of discourse, 
a ccmpleto list of the essential component skills, so to speak, the 
necessary ^'ingredients*' of a complex skill* However, the fact that a task 
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Xottcis oo sdvdral factors my very mil mm. that the criterion tasic involves 
alternative ooniponent skills rattier than that each of the skills represe:ited 
hy the several factors is important « deferring to the factor description 
of tlia water*Jar prohlem, it may he with respect to any single individual 
that the skill involved in perfonoance on the prOhloBt is Cfeneral keascnlng 
or liO^lcal Svaliiation w Adaptive Flescihility* the factor recipe dose not 
seem to tell the cook which ingredients are essential and whf.e.h can ioe 
suhf^tituted for ctie another « 

A description of a task in tei^s of factor loadings can tell what 
characteristics differentiate the performance of individuals on the task,?] 

But the factors that diffex*entiate individuals are not necessarily in ono-> 
te»one correspondence with the factors that are relevant to performance on 
a task, fhe relevant behaviors that all of the members of a sample manifest 
or manifest in a sufficient degree cannet be revealed by correlational 







methods. By the same line of argument^ the relative importance of various 
components of a complete task is not necessarily to he found in the magnitude 
of the loadings of the task on reference factors. 

Finally^ there is the problem of naturalistic bias in analysing tasks 
in terms of factor loadings. Such a procedure indicates which skills 
differentiate the perfonaance of persons who^ usually^ have no special 
preparation for the task at hand and who work at the task for a short 
period of time. It seems reasonable to suppose that especially qualified 
persons mathematicians^ operations researchers^ psychologists emplc^ing 
futtctional’^behavioxal methods of analysis^ depending upon the kind of 
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P 7 dbl 9 m f^ith ample tisia for study can develop approaches to the solution 
of classes of prOhlons that are not inferior to thojte inferred frcuo the 
hehavior emitted by students frcn l?sychology 100 uhen briefly confronted 
with the tasjr, perhaps it is ic^e te inquire ** with either multivariate 
inva^stigations or with process-traciiig studies whether or to what degree 
the c<^ponent@ of ''ideal strategies" are exhibited in the behavior of 
college sophmores or Air force recruits « When a conception of an "ideal 
strategy'^ is avail^abie it often should be possible.' to develop training 
procoilures that [Systematically arrange the required skills If and when a 
high level of proficiency can be produced ^ the task will no longer be called 
a problem and it ®ay even fee said that the task does not require "real 
thinking" or tiiat it can be performed by "rote", But^, then,_, what is the 
point of this §ame anyway? 

mie ccEiclusicn is that under scioe circumstances descrlpticn of a 
c>fjmplex task in terms of loadings on reference factors might have seme value 
as an adjunct to task analysis. However, from the perspective of the 
psychologist concerned with training, it is inconceivable that factor 
descriptions could bear the principal burden of task analysis. 



Aptitiide Factors and the Effects of draining 

This section will examine investigations of the relatiociships of factor 
structure at^^d training, fhis was a popular topic in the lh30*s> In recent 
years there are Fleishman *s Ce,g., Fleishman & Hempel, 1954 ^ Fleishman, 1^?> 
studies of the chan;’es with practice in the factor structure of comi^ex 



Iisyehooiotor tasks. Stake C3.SCX) has eeiaplewed nost suhstautlaX^ 
inirestlgatioa examiniag conceptual learning^ an itiv?stipition involving 
training <m 12 tasks and an oktonslve battery of reference tests. 

Though each has emplo^d factor analysis^ there have been distinct 
differences in mthodology among these studies^ partly as a function of the 
particular issue that interested the investigator. In t^rms of the interests 
of this paper^ Fleishman *s method is among the most touristic. He broke 
performance up into intervals and as a result was able to study the changing 
characteristics of performance interval by interval as training progressed. 
Fleishman's work indicates that there are systematic ''changes in the patterns 
of abilities contributing to proficiency on complex tasks as training continues 
and proficiency increases" C195T# P. 271>. In other words^ qualitatively 
different skills^ not merely different degrees of the same skilly seemed to 
be involved as proficiency cm a task increases. There is a task^specific 
factor^ the importance of which usually increases as training continues. At 
the same time the amount of variance explained by reference tests usually 
shows a regular decline as training progresses* It is not known whether this 
latter fact is inevitable or whether it merely reflects the current state of 
the art of testing and the psychology of individual differences. Of simcial 
interest is Fleishman's finding that tests of "higher processes" are 
Important mainly in the early stages of performance. These diminish in 
importance as training advances. 

Though there may be some^ to the author's knowledge^ none of the studies 
of the effects of training and factor structure in the so*calied "cognitive 




have axaatly the same ssetbodoiogy as FleiJhaiae* fheife have 

been seiae iatei^stiag isivestigations though* A study of Ww^odrow*! C1938) 
is es|>eGially provocative „ Subjects practiced lihc-ut ten ailautes a day on 
each of seven tashs for 39 days* 'fhree scores were obtained for tash^^ 
initial, perfoxtiance^ final perfonaaeice^ and gain^, that is the dtffe»*eii.«e 
between initial and final perfonaance* the iiitercorrelations of these 
scores^ scores on two intelligence tests, and scores on several tests given 
Just once were factored using the centroid aiethod* the discussicn tliat 
follows has reference to the varioiaK ClC^isor, 195S> rotation of Woodrow** 
centroid matrix which appears in Table 

There is an extremely interesting generalisation that emergriiS irm 
Woodrow’s data: Terminal performance was related to both in&tial pc?:?*for?saaoe 
that Is, entering behavior and gain or improvement* However .j, and this 
is the fascinating point, initial performance and gain were remarlssbly 
ir/i^pendfttt of one another on all but one of these tasks Cepot patterns) « 
Notice that terminal perfonaanee for any task tends to load oe two ^actors, 
one of which is saturated with initial performance and the other of which 
exhibits a high loading on gain or Improvement with practice* final 
performance showed a more pron<»inced relationship with initial performance in 
some cases but with gain in others* On the one task that could be said to 
involve problem-solving, the anagrams task, final performancse was much more 
highly related to initial performance than to gain* Speaking generally, 
one would suppose terminal performance on many tasks employed in laboratory 
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stadias of loaming would have a **olatlvoly aliglit xolatiou to initial 
performance^ indeed^ such tashs are frequently selected precisely because 
they de-emphasiae the role of entering behavior* Ou the other hand^ it is 
to be ©scpectcti tlnat initial performance will exhibit a hefty association 
with final performance on many tasks thiit confront children in school; for 
cultiisrally relevant tasks^ a brief pe .’iod of training weighs small in 
prcportioiu to a long nistory of learning* 

Hot ice that cai Woodrow *s first factor (see fable 3>, which can be 
called there t© a tendency for final performance oti most of the tasks to 
have a smaller loading than initial perfoi^ance* Though the diffC j?ences are 
not impressive^ the trend in those loadings is consistent with the view that 
the skills represented in Intelligence tests are less important at the end 
of training than at the beginning^ a result not unlike Fleishman* s« 

The idaln coaclusion that can be gleaned frcm the iavestigati^s of the 
relationships between factor structure and training is that aptitude tests 
are very truly measures of entering behavior* As Woodrcw (see 1946) 
repeatedly argued and rather dramatically demonstrated^ these tests do not 
measure "ability to learn *"^ In the case of ccmplex behavior and ccmipiex 
training procedures — let us say, an auto-instruc^tional program to teach 



^Stake (1961) who has identified ability to loam with spiked of 
learning rather than amount of improvement, found some weak speed of learning 
factors* It is not inconceivaole that additional research with existing 
tests, or research with new tests might reveal some associations with 
learning (either speed or amount of improvement) but, still, the conclusion 
that for the most part aptitude tests measure entering behavior seems sound* 
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a scbooi subject It is probably true that relevant , previously leamecl 
behavior ‘‘enters** at various points 4uring i^isti action, not just at the 
beginning. 

eagnct'^ (Gagne^ 1G62| Gagne^'an^ paradise^ 1961) has also identified 
aptitude tosts v^itb entering behaviors however, his analysis siiggests that 
the behavior reflected in basic aptitude tests “enters** that is to say, 
is relevant mainly during the initial stages of instructicHt, and is 
decreasingly relevant thereafter. The present author’s suspicion is that, 
even when a complex skill is analysed recursively into a hierarchy of 
subskills using the technione that 6agne"^has expounded, various previously 
learned skills will become more or less relevant in a shifting pattern 
as learning progresses. Such shifting patterns were revealed in Fleishman *s 
studies, even though the psych^otor tasks employed in these studies were 
relatively less complex than the academic tasks that Gagne^ talks about, and 
tim» training procedures used more homogeneous than the instructicm repaired 
to teach academic skills. 

Barlier, it was suggested that there is a naturalistic bias in task 
analyses in terms of factor loadings. There appears to be another facet to 
this naturalistic bias. Training, some of the time at least, perhaps most 
of the time, has the effect of changing the patterr^ of factor loadings. The 
magnitude of the change presumably depends upon lie effectiveness and the 




extent of training and the degree to which previo aly acquired skills are 



relevaiit to the task at hand. Nonetheless, one can speculate, the direction 
of the effects of training Is generally toward a *Wt in factor pattern. 






/5 







■"] 




61 

in otliar words^ a change la the ifelevance of |»te>©vloiiilyleafiied •killa* If 
this is true^ then factor analyses of measures on naive stibjects could yield 
only an imperfect deecriptiem of the cemponent skills Involved in highly 
proficient porformance folloeit^<r a period of training* 

We are ac /astoaed to speak of an **lncrease in proficiency** on a task^ 
but such an exorossion permits the inference that the sane skills comprise 
nos^ice*-level perforoiance and master* level performance^ that the two levels 
and intervening levels differ only In qaantitative degree* There are both 
analytic and empirical grounds for resisting such an inference* It is 
probable that different levels of proficienoy en complex tasks^ if not simple^ 
homogeneous tasks, usually involve qualitatively different skills* Similsrly, 
even if by sane external standard of proficiency, two groups — one with 
training of a certain sort, the other without — happsn to perform at the 
seme level, it cannot be assumed that the same skills are involved* In fact, 
it Is very likely that the skills are different « 

To put the whole matter another way, behavi<xrs bearing a certain task 
or function name can show markedly different topograi^es* from some frsmss 
of reference, these differences in topography are unimportant* When the 
issue is Judging what an organism will be able to do la the future on mere 
complex tasks, m what it can do now| or the issue is planning a 

training procedure that will most efficiently build upon the organism* s 
current repertoire of behavior $ or the issue Is analysing a complex skill 
into simpler, compenent skills, topography can be very critical, indeed* 
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Iiit»y>ctiotta of Aptitude gactoys and fyalning Vayiiiblini 

Stoltuf^ C)>965> has reo«titly reviewed studies showltig iiiterscti^s 
between sbiXlty end tecimiciues employed in seli<~itistrttctionei prisms* ttie 
evidence reviewed by Stoluror# suggests that programs featuring knowledge of 
results^ overt responding, and immediate feedback make a dilferenoe with low 
ability students, but that high ability students do just as well on programs 
without these features « Other studies seem to indicate that programs 
allcwlng **self*direotion*' are superior to linear programs f<n^ bright students 
while slow students do as well Cbadlyl with either kind« fie should be noted 
that freguently the apparent interactions, usually in the form of correlations 
of different magnitudes between an ability measure and a criterion performance 
measure, are discovered in ^ post facto analyses* gtill, considering the 
fact that most psychologists concerned with lemming and training have not 
been very concerned with individual differences, the facts available suggest 
that rather often there are interactions between ability and training 
variables* 

Stoda js involving several training conditions in which scores were 
Obtained on a differentiated battery of aptitude tests are scarce Cthough 
see Dick, 1963) * mie whole thrust of the analysis presented on the preceding 
pages is to suggest that interactions between aptitude fact^s and traihiing 
variables are likely to be the r^tle rather than the exception, at least for 
complex tasks and complex training procedures, such as programs to teach 
academic akills* 
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Of ¥mt worth to the training i^aychologiat is it to know that there is 
an intoraotion hetwoon training ooiifliti«ms-and an ability laaasuro? Imt it 
bo assuBWid that the intoraetion is aanifostod in diifaroncos aiaong training 
conditions in the degree of correlation between the ability laeasiire and tbs 
criterion perfonaance laeasure. Is a high correlation a favorable sign? 
According to scae educators^ the answer is yes. it is a part of the 
edacational folklore that there is an increase in the variance of the 
acbievenent scores of students of the good teachor^ since he stinulates bright 
pupils to forge ahead to a greater degree than does the aediocre teacher v 
the p«>pular answer of persons in programed instruction is no^ a high correla* 
tiott between an ability measure and a perfonaance measure is not a 
favorable sign, the reasoning is that with effective instruction oven tim 
%1ull student will achieve a high level of performance, the fact of the 
matter is that in and of Itself the magnitude of the correlati<m between a 
measure of ability and performance is neither favorable nor unfavorable. 

It all depends on the means . When the mean level of achievement under vji 
certain training condition is hi^r than the level unde^ a standard 
condition^ that is good; when the mean of the training condition is loser 
that is bad. The difference in the correlation of the ability measure and 
the achievement measure under the training condition and under the standard 
condition and the difference in mean achievement under the two cenditions 



can, provided several assumptions hold, suggest the kind of student who has 
profited most or least from training* If mean achievement is higher and 
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coi*]ft(3X&'tiQii bCDtiwoon &chiGv 6 ni 0 n't snd ftbili'iby is feigilisjpj, Ishso pyoimbly 
tbs dull 8tudS£it did |»oorly as usual whlls tbs bright studsnt did esfiscimlly 
sail. This is tbs case many educators who deal with conventicnal forms of 
instruct ion feel is typical C^esirahle?)^ If mean achievement is h i gh er 
but the correlation of achievement and ability is loser under the training 
condition than under the standard condition, then probably the los-ability 
student profited especjally and the high-ability student did as well as 
usual, fhia latter case is often seen in programed instruction studies. 

remarks that have Just been set forth apply as well to general 
ability teats and differentiated aptitude measures. A second aspect of the 
issue has particular reference to differentiated aptitudes. There are those 
who cay tijat if following e certain training regimen, achievement scores 
show a relatively high correlation with some special ahlllty, this proves 
that the instruction requires reasoning, creativity, oi whatever (see Braund 
& Heath, 196S) aad, indeed. It does^ It proves that the regimen makes 
salient certain skills. But It does not prove that this training procedure 
is to be preferred to some other. It is entirely possible that another 
training procedure that led to lower correlations of measures of reascNaing 
or creativity with final performance, would result in higher levelc of 
performance on problem-solving tasks involving reasemting or creativity. 

Several of the foregoing points are illustrated by the data in Table 4, 
Thirty first-grade children received training designed to teach them a 
problem-solving skill, the skill of attaining a concept or solving s problem 
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t>y varying €»acli factor in aucceasion whll» holding all other factora 
coaataiit« The training uaad the techniimoa of programed inatruction, though 
it to<^ the f C l j of a script uaed by a hviman teacher C^ith one child at a 
time> rather than a aelf**inatrttctiotial te*tt or a teaching machine program* 

In the initial phaae of training^ the program eaa divided into aeven unite 
called **gamea** that mere de:«igned to teach componenta of the deaired 
terminal behavior* The firat three gamea ari^ged **concluaiOtt-’draming 
behavior*' and brought thia behavior under the appropriate atimulua control* 

The remaining four gamea arranged "inatance^aelection behavior" and integrated 
coneluaion drawing with instance selection* The second phase of training 
consisted of an abbreviated form of the program with each of five widely 
different, additional tasks* The purpose of the second phase of instruction 
was to vanish the control of particular task and problem characteristics and 
bring the behavior under the control of the relevant abstract or schematic 
attributes of tasks and problems* 

Following training, the training group and a control group that 
received no treatment of any kind, were presented with a series of problers, 
some from tasks that had been employed during training in order to assess 
retention, and some from tasks new to all childien to assess transfer* The 
problems were exactly like those employed in the Walsh and the Conry studies 
previously discussed* For each problem, the child began with a stimulus 
configuration which was, he was told or shown, a positive instance of a 
concept C^*g*9 it "shows the secret")* The child was instructed to select 
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©r e^mtm instsnees C«.«., **Pick cards,” ”»ix ciisBiicals”) imtU lia couiH say 
tha cmicapt* tbrn child Kras scored as havino? solved a problott if the Instaacos 
hs ssloctad Inpliod ths concapt hs stated and ao other. A further descrip* 
ticu of the tasks and the siethod, as veil as the ealu recslts of the study, 

eaa he found elsewhere (Anderson, lShl)« 

Four hundred and eight first graders, including the 60 children who 
w ere presented the problem* solving tasks, ccmpleted the California Test of 
Mental Iftiturlty (Long Pom, 1057 Edition) . Subtest scores were intercorrelated 




and factor analysed by the principal coapoiients method. Pour factors were 

extracted and rotated using the varimax (Kaiser, 1958) procedure (see Table 3.5) 

INictor scores were computed for the 60 children who received problems. 

Each task was represented by a composite prOblem*solving measure, the saiee 

3 

ideasure as was used with the Walsh data previously discussed. 

table 3.4 contains the correlations of the aptitude factors with the 
problem**solving measures. It should he noted In passing that the sample was 
rather homogeneous with respect to XQ and SES. ierhape stronger relationships 
would have been observed with a more heterogeneous sample, though there is 
detail in the table that lOMOks interesting, remarks will he limited to two 
Observations. First, notice that over-all the aptitude measures account 



^tbe composite score consisted of the sum of tfie standardised scores 
for number of unnecessary trials (^fleeted) and nuiiiber of solutions, the 
measures were standardised separately for the training group and the control 
girottp* the median correlation of unnecesiary trials and solutions for the 
various tasks was .58, a coefficient high encugh to support the belief that 
the two scores represented the same thing. 
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first prot^Ieci — m&cooxt |»robleci correXsticet extended vitti tbe Speareisii-Broirn fomttXs* OnXf one penduXiiffi 
IirdliXest ess presented* 
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tm mom ot tlit v«riftiio« of tii» tirtlaiiif group thaa of tha oontrol group* 

Siuoo tha levol of porf oraaneo of tlta training group «aa kigliar tlian t!iat 
oi tlm control anei ainoa^ oxoapt for tlm cbanical tlia roliaMlity 

of tlao problOB-ioliring naaauro uaa about tba ansa for tba tao groupa^ tlia 
coKralationa auggaat tbat tbia ia a caaa in abieb training banafit#4 tba 
bright atudant noat* To look at tba iaaua in anotbar aay^ tba antaring 
babaviora or abilla rapraaantad by tba aptitude faetora aara angagad or nada 
aaliant by tba training prooadura* Sacond^ tba training aaanad to ebanga 
tba pat’i'am of ralavant abilitiaa aomavbat* Manoi/y aaa a nora proninant 
factor In tba probl#n*‘aolving of tboaa vbo racaiyad trainivig than tboaa wbo 
did not* book particularly at tba corralationa of nanory aitb parforaanca 
on coaboya tank and tba pagboard tank, taaka tbat iiara anployad during 
training and upon which aioat of tba cbildran raaebad a ratbar atringant 
critariott of aaatary* 

bbanavar an aptitude naaaura abxva a narkad corralation with a taminal 
parf oraanca naasura^ ona typa of aubjact ia doing laaa wall than anotbar* . 

Tbia information could ba uaad to impreva tba training proeadura* Cna 
altamatlva ia to davalop diffarant training procaduraa for tba diffarant kinda 
of paopla* Thera are a rariaty of forma tbat aucb an approach cculd taka^ 
ranging from wholly diacrata pregrama to a eollaction of training aagmanta 
tbat could be aaaamblad according: to a formula baaed on a vector of acoraa 
for each atudant (aea Stolurow a sbivia* 1965) * 
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SuMMirir 

To {Nill. togot1io» aod otumriso vliat has boon taici in tbia first 

frOBi ths psrsiisctivs of tbs o^fchoiogist conosmsd sitli davsioptag training 
]>rocsdurds to arrangs proOisn-solving skills, a dosoriotion of tasks in tsms 
loadings on aptituda rafaranoa factors aigbt scoatinas proaa to ba a 
tisafttl adjnnct to otbar task analysis nathods« But tbara ara savaral raasons 
iiby suc^ a tacbniqua could not coaprisa tha principal aathod of task 
analysis* Sacond, studios of tha ralationship batwaan training and factor 
iitructura saan to indicata that aptitude tasts ara prinarily naasuras of 
4intaring bahavior, for tha most part unralated to hoa nuch inprovanant aill 
:rasult frein training* Whan tha task or tha training procadura is at all 
cciaplai;, a shifting pattern of ralationshlps bataaan aptitudes and parforaianca 
on tha training task is likely to appear* Tha shifting pattern indicates tha 
changing ralavanca as training progresses of tha praviously*>laamad skills 
raprasantad by tha aptitude factors* Third, interactions, oora expressly 
corralations, bataaan aptitude laaasuras and parforaianca after training contain 
infonnation that can be anployad to improve training by matching tha kind of 
training to tha kind of paracm in one of savaral possihla mays or modifying 
tha training procedure so that thoaa with lea aptitude scoras a<diiava hatter, 
Xooatbalaaa, there is good reason to be suspicious of a judgment about a 
training procedure ahan that judgment is based m a correlation coefficient 
alone* Finally^ such data on aptitude factors and prOblem*solving behavior 
as are available ara conaiatant with tbs belief that problam**solving ia not 
asssntially different from other varieties of behavior * 



n 



Infornatioit tliat achievement correlatea highly with an aptitude 
meaaure might be used in a second way* iJnder acne circunstanoea^ it might 
be possible to modify a training procedure so that those with the low 
aptitude score have a better cdiance of succeeding* If one i^i speaking of 
differentiated aptitude factors^ and this had been the presumption in the 
foregoingj, the aptitude factor itself might suggest the sort of modification 
that would isiprove the performance of those with low scores* For ittstance, 
if Verbal Comprehension is a factor that is strongly associated with achieve* 
meat, perhaps a simplified vocabulary is indicated^ or perhaps in the sections 
in which verbal complexity is unavoidable more trials or frames are needed* 
Ordinarily^ aptitude tests are used to diagnose the failings of students* 

The suggestion is to use aptitude tests to diagnose the failings of training 
procedures^ It is difficult to forecast how useful aptitude tests would 
prove in the diagnosis of the shortcomings of training procedures* It could 
be that the information obtained from correlations between aptitude measures 
and performance measures would turn out to be Just an expensive^ indirect 
substitute for information obtainable by more direct means* 

In this section^ tHie argument has been that interactions between ability 
measures and training conditions are probably the rule rather than the 
exception* But* caution was urged in interpreting interactions, especially 
those that appear in the form of correlation coefficients* Neither the 
asserticn that the correlation between ability measures and terminal per^ 
formance goes up with effective training, nor the contrary assertion is 
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imiversaXiy true. The edequacy of a training procedure must be judged by 
the level of perfonoance attained « Correlaticne of achievettent with ability 
neaaurea^ particularly differentiated ability measures j, can suggest the hind 
of student eho profits most or least froa a certain training procedure. 

Based on this information^ there are several courses of action that could 
improve training. When differentiated aptitude measures are employed, the 
aptitude measure itself might suggest the sort of modification that would 
improve training, though it remains to be seen whether this suggestion has 
any actual value* 
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CHAPTl^ 4 

Task factors aad Aptitude factors In Children *s froblea Solving 

the purpose of the research reported In this chapter vas to escplore 
the effects of task factors and aptitude factors on children's problem 
solving* With respect to task factors « the first factor iims type of 
aiaterlals*'‘*card array* cowboy game* and pencil collection* While these 
materials were not systematically chosen to represent points In a 
conceptual space* It was Important for the program of research to dls* 
cover any systematic differences among the materials* The second factor 
was number of relevant stimulus dimensions* The concept to be attained 
by the child was defined by either one stimulus dlmetuilon (e*g* color), 
two stimulus uimenslons {e*g* color and form)* or three stimulus 
dimensions (e*g* color* form* and number)* A third factor was order of 
presentation of materials, in other words, the effects of practice* Type 
of materials* number of relevant stimulus dimensions* and order of 
presentation were factors In a within**subjeets analysis of variance design 
A fourth factor* the nature of the particular stimuli defining concepts* 
was nested within Hater i&ls and Dimensions* Instead* for instance* of 
representi£.g l-^dlmenslonal card array problems with a single concept—. 
say ked-*.ilx independent subgroups got l^dimensional card array 
problams involving six different concepts* 

The second purpose of the research reported in this chapter was to 
invastigate the relationahips between aptitude factors and problem 
solving perfotmance* All of the children in He available population 
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vtere giv«ii a battery of 24 altitude testa iateaded to mark 10 established 

i ' 

aptitude factors « Scores oa the tests were intercorrelatsd# The 

correlation matrix was factor aaalysed* then problem solving performance 
was studied in relation to the factors* Froia perspective of the 
behavioriatt aptitude factors <or factor scores) represent the operant 
level of skills often important for human performance on a wide range 
of tasks* In other words aptitude factors represent entering behavior* 
the work of Fleishman with complex psychomotor tasks shows that the 
pattern of correlations of aptitude factors with performance at various 
levels of proficiency can yield valuable information about the relevance 
of different components of entering behavior. A Fleishman type analysis 
was completed, the rationale for this sort of analysis, along with a 
discussion of its strengths and particularly its weaknesses, appears in 
Chapter 3. 



Method 



Subjects. All of the approximately 210 children in the fourth 
grade in three elementary schoc>ls In a self-contained , midwestern town 
of 19,000 completed a battery of 24 aptitude tests. A random sample 
of 144 of these children later received a series of nine concept 
attainment problems, sample included both White and non-white and 
both lower-class and middle-class children. 

Frocedure. the aptitude tests were administered in the regular 
classroom by one of six e3q»erimenters* the classroom teacher assisted. 
Froblems were administered in individual sessions in such reasonshly 
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and pvlmte spaces as the schools were able t© furnish* Bach subject 
received problei&s from a single experimenter* The procedure for 
presenting and scoring problems ^-7as detailed in Chapter 2. 

Design* Each of 144 fourth graders received nine concept attainment 
problems in a design which involved four factors* Ihey %»ere (A) Order 
of presentation of materials » (B) ^pe of materials, (C) Number of 
relevant stimulus dimensions, (B) Order of presentation of problems 
within materials* The design can be diagrammed as follows* 



Group 




tl 






A 2 






A 3 




01 


02 


03 


01 


02 


03 


D1 


02 


03 


1 


Vi 




®xS 


V2 


V3 


Vi 


B3C3 


Vi 


V2 


2 


V 2 


V 3 


Vi 


Vs 


Vi 


V2 


Vi 


V2 


Vs 


3 


hh 


Vx 


B3C2 


Vi 


V2 


B3C3 


V2 


Vs 


Vx 
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Bach subject moved from left to right along one of the rows in this 
table* In this design "Group'* is a sequence factor* Order of presenta** 
tion of problems within materials, which was included for reasons of 
experimental control and is not of intrinsic interest, was ignored in 
the data analysis* b*hen this factor is collapsed, there remains a 
fixed-effect design involving repeated measures which Winer (1962, 
pp* 571-574) calls Flan 12* There were two additional orthogonai 
factors which were not included in the main data analysis* The first of 
these was ^perimenter, which can be thought of as a replication factor 
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since esch escperjbcmiter ran 24 subjects in a miniature version of the 
experiment as a vhole. PreXininary one-way analyses of variance 
indicated no effect for experimenter, hence data were pooled in sub- 
sei|uent analyses* Concept subgroup was the final factor* Independent 
groups of subjects receivecl unique sets of problems* Concept subgroup 
could be regarded as a fixed factor nested within Hsterials and 
Dimensions* the main reason for including this factor was to broaden 
the base for generalization* It would be presumptuous to make ruch of 
differences materials when each set of materials was represented 

by only three of the 27 possible concepts which could be formed within 
each set* In the present experiment, each set of materials was repre« 
seated by IS concepts. Similarly, each level of Number Relevant 
Stimulus Dimensions was represented by 18 concepts instead of three* 

It would have been possible to sample at random from among the concepts 
that can be formed within each set of materials* Such a strategy, at 
least by the classical logic of inferential statistics, would have 
permitted even iiore confidence regarding the limits of generalisation* 
The author chose the alternative strategy of choosing concepts on the 
basis of an a, priori analysis which can be argued to guarantee that all 
possible kinds of concepts are represented in known proportions* This 
would seem to be the only sensible decision* After all we are not 
dealing with an indefinite number of field plots which will receive 
rainfall in unpredictably different quantities* 

Ckincept subgroup could have been included as a factor in the main 
analysis* However, it was not included since the lateractions, if any. 
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of this factor with other factors would have heeti uninteresting and 
probably uninterpretable. Instead, differences aiaong concepts classified 
according to materials and number of relevant stimulus dimensions were 
studied in separate analyses. In the main analysis, scores were pooled 
across concept subgroup. At first glance it may seem uhat under this 
procedure the effects of concept subgroup are being included w&thin 
error. However, this is not the case. All of the factors of interest 
involved within-subject error terms. 

It goes without saying that subjects were randomly assigned to 



experimenters was random with the constraint that each expo.rimenter 



(a) The fourth graders within each school who completed all of the 
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sequence groups, concept subgroups, and experimenters. Assignment to 
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Aptitude tests# The 24 aptitude tests were chosen to mark ten 
expected factors. The toual for Kit of Reference Tests for Cognitiye 
Factors (French, Ekstrom, and Price, 1963) served as the chief basis for 
expectations about factors, as the guideline for choosing tests, and as 
the primary source with respect to interpreting and naming factors* 
work of Guilford and his associates was also consulted (Guilford, 

Christensen, and Frick, 1962; Wilson, Guilford, Christensen, and 
Lewis, 1954). 

At least two tests were selected to mark each expected factor* 



There were four sources of tests. Given below is the abbreviation used 
to credit the source. (iTS) The C|f Reference Tests developed by a 
variety of persons and published by the Educational Testing Service, 
(PMA) The Primary Mental Abilities battery developed by Thurstone and 
published by Science Research Associates • (NYU) The Solying Puzzles 
tests developed by Kaya (1960) at Hew York University. (TRL) Tests 
developed by the author and his associates in the Training Research 
Laboratory at the University of Illinois. 

The tests are listed below by name. Included Is the source 
credit, the factor with which tlie test is presumably saturated, and a 
brief description of the test* 

1. Pictur e-Number » ETS. Associative Memory. The subject sees 

pictures of common objects paired with numbers. He memorizes 
the number which goes with each plcttjire, then has to write down 
the numbers on a page that has only the pictures on it. 

2* First Hame and Last Names . STS* Associative Memory. This Is 
similar to the first test except that the material is all verbal. 
The student memorizes a list of names and then must write the 
first names in blank spaces preceding the last names. 
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3« SUbtyctloii and Maltiolieation* fitt* Hinbar Facility* This taat 
ia ttothiag aora tfiaa a aairiaa of aubtraetion and Miltiylieatioii 
probliaa* 

4* Spatial Ori^tatioa * tSl* Syatial Oriaatatioii* This ia a typical 
apatial oria&tatioa teat ia ^ich a aaiqilc aad four altataatiraa 
asa provided* tha aupjaet nuat aalact tha altaimativa ifhicli ia 
identical to tha aaapla ma^pt for baing rotated* 

Fiiidina *A*a* ETS* Fareaptnal Spaed* there ia s long liat of 
aorda* tha aubjaet iMiat eroaa out aa aany aorda containing tha 
latter "a** aa ha can within tha tiaa liait* 

Wetda* FM4* Verbal Conpraheneion* thia ia a vocabulary teat* 
tha atdijaet ia required to aalact the word from aaong four 
altarnativea which haa the aaote aeaning aa the aaiipla word* 

Ficturea. FH4* Verbal Comprehenaion* thia ia another vocabulary 
teat* tha atudent ia shown four picturaa and ia aatcadt for axcwpla» 
*flhich one ia the dogf^' 

S* Hunibar Sanaa* £H4* Nunber Facility and General Reaaoning* 

Included are aritfinatic word probleya and problana in which the 
anbjaet miat fill in the niaaing nuadiar in a nunbar a^iaa* 

9* Addition * FMA* Niiaber Facility, lltla conelata of 30 addition 
problv^* 

3natial* FHA* Spatial Orientation* The aubject ia required to 
aalact tha one figure iron anong four eltamatlvea vhen 

coabined with the aample figure^ will produce a aquare* 

Ficnra Grounina;* FHA. Induction* Four f iguree are pr<iaented* the 
etudent^ia required to select the one which ia diffarant frott the 
other three* 

12* Herd Groupina* FMA* Induction. Four worda era praaantad, three 

cf which ehara eona property* tha subject nuet aalact tha odd word* 

13* Farcaptuel Snead* FMA* Perceptual Spaed* Four pictures are 
praeantad* tha student fiiiat aalact the two pictures idiieh ere 
identical* 

14* Solving Fuaalea JU Bill. Flexibility* tha student is required to 
find hidden word? in a longer word* 

IS* Solving Fuaalea 2 (f Irat scoring) • HiO* Idaational Fluency* 

tha score ia the** Kotal nu«d>ar of anawara tha subject gives to such 
quaationa aa *1iiuie all the round things you can think of**' 
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3*6* So^Lving Puzzles 2 (second scoring) • Nifg, Originality. The score 
here is the proportion of unusual or original miswers. 

17. Solving Puzzles 3 (first scoring). NfO, Ideational Fluency. This 
is siiailar to test 15 j except the tests Involve the uses of objects, 
for example, "Write down all the different ways you could use a 
string.'* 

18. Solving Puzzles 3 (second scoring). NTH. Originality. The score 

is the proportion of answers to test 17 iMhich are unusual or original. 

19. Solving Puzzliis 4. NYtf. Organization. The subject is required to 

produce a woif^rwhich is simultaneously synonymous to two words ^ 

20. Solving Puzzles 5. WT0. Organization. The student is given four 

words and is required to write a very short story with two or three 
sentences using all four words. 

21. Solving Puzzles 6. NT0. Flexibility. This is the "match-stick 

puzzles test." There is a figure drawn of match sticks; the 
directions to the subject are, for example, "Take away two matches 
and leave three triangles." 



22 . 



23. 



Solving Puzzles X* TOI. Flexibility. A series of words is arranged 
according to some rule; the student must discover and state the rulo. 

Solving Puzzles 8 (first scoring). NYO* Ideational Fluency* A 
drawing is shown. The score is the number of things the subject 
lists that he thinits the drawing could be. 



24. Solving Puzzles 8 (second scoring). WY8. Originality. The same 
as test 23, incept that the score is proportion of original answers . 



Measures of skewness and kurtosis were computed. Seven distributions 
departed sufficiently from normality to warrant transformations. Square 



root transformations were made on tests 1, 2, and 21. The scores on 
tests 12 and 20 were squared. Arcsine transformations were made on two of 
the three ratios, test 16 and test 18. After these transformations, 
skewness and kurtosis fell within normal bounds for all tests. 

A components analysis w^ performed. The correlation matrix, with 
l*e in the diagomtl, was analyzed into principal components. Factors, or 
components, with latent roots greater than 1 were roteted using the 
varimax procedure. 
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Task factors and problem solvlne 



Specific concepts# For this phase of the analysis there tiere three 
dependent variables: (1) Ihimber of solutions to the problem; (2) Humber 

of inappropriate choicr^i^ of instances* ^ich is the sum of inefficient ^ 
redundant, and repetitious choices; and (3) Hund>er of inappropriate 
conclusions, which is the sum of inconsistent, consistent-but-invalid, and 
miscellaneous conclusions* The details of the scoring procedure, it 
should be mentioned again, and the logic upon which these proceAurea are 
based appear in Chapter 2« 

Tables 4*1, 4»2, and 4.3 contain the means and standard deviations 
for the card array, cowboy game, and pencil collection, respectively* 
Analyses of variance were performed on each set of six means. It should 
be emphasised that these analyses were not independent. The same six 
subgroups were involved in each analysis. For what it is worth, there 
were three significant (a « .05) F ratios. There were significant 
differences in proportion of subjects solving the problen among 2« and 
3'*dimensional card oxt&f concepts and l-»dlmensional pencil concepts. 

Effects of order of presentation , type of materials and number of 
relevant stiiftuius d^««i>Tiifiions . For this phase of the analysis there were 
four dependent variables. SuDamary problem solving performance, a measure 
discussed in Chapter 2, was included in addition to number of solutions, 
nuflber of inappropriate choices, and nun^er of inappropriate conclusions. 
Enlike the latter three measures, which are simply counts of '‘natural 
units,** the summary performance score is a derivative measure in an 
arbitrary metric. Nonetheless, the summary score has the advantage of 
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Table 4.1 

Card Array Coneeot Means and Standard Deiriatlons 





Proportion 


Nttmber 


Number 




Solving 


Inappropriate 


Inappropriate 




Problems 


Choices 


Conclusions 


Coneefit 


H SO 


M SD 


If SD 












I'-Dimensional Problems 






One 


.75 


.44 


1.33 


1.17 


1.29 


1.55 


Eed 


.63 


.49 


2.00 


1.10 


1.00 


1.47 


Box 


.88 


.34 


1.33 


1.01 


1.38 


1.35 


TWO 


.83 


.38 


1.54 


1.18 


1.17 


1.01 


Green 


.83 


.38 


1.67 


1.17 


1.25 


1.11 


Diamond 


.92 


.28 


1.25 


.90 


.92 


1.21 


£ ratio 


1.70 




1.59 




.45 










2-Dfmensional Problems 






Green Diamond 


.71 


.46 


1.00 


1.22 


.75 


1.03 


TWt> Green 


.58 


.50 


1.54 


1.44 


1.17 


1.34 


Two Diamond 


.88 


.34 


1.33 


1.49 


.92 


1.38 


Red Box 


• 79 


.41 


1.17 


1.40 


•46 


.78 


One Red 


.54 


.51 


2.04 


1.37 


1.33 


1.31 


One Box 


.88 


.34 


1.46 


1.10 


1.13 


1.36 


P ratio 


2.63* 




1.73 




1.63 










3^’Dimensional Problems 






One Red Dlnmond 


.58 


.50 


1.58 


1.53 


.88 


.90 


Otie Green Box 


.58 


.50 


2.00 


1.35 


.88 


1.36 


TWO Red Box 


.67 


.48 


1.67 


1.69 


1.17 


1.24 


Two Green Box 


.88 


.34 


1.21 


1.22 


.25 


.61 


TWO Red Diamond 


.50 


.51 


1.92 


1.50 


.96 


.81 


One Green Diamond 


.83 


.38 


1.63 


1.31 


1.13 


1.33 


£ ratio 


2.57* 




*91 




2.25 








* 

P < 



•05 
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fable 4,2 

Cowboy Concept Means and Standard Deviations 





Proportion 


Number 


Number 




Solving 


Inappropriate 


Inappropriate 




Problems 


Choices 


Conclusions 


Concept 


M SD 


M SD 


H SD 



Riding ,71 
No Cun , 75 
Hat .88 
Standing .71 
Cun .75 
Bareheaded .88 

f ratio .82 



Standing Cun .87 
Standing Bareheaded . 54 
Cun Bareheaded .75 
Riding No Cun .75 
Riding Hat .75 
No Cun Hat .79 

F ratio .96 



Riding Gun Hat .75 
Riding No Cun Bareheaded .63 
Standing Cun Bareheaded .75 
Standing No Cun Bareheaded ,67 
Standing Cun Hat .67 
Elding No Gun Hat *79 



l«.Diinensional Problems 



46 


1*83 


1.17 


.88 


1.08 


44 


2.04 


1.40 


1.00 


.88 


34 


1.79 


1.61 


1.04 


1.27 


46 


2.04 


1.27 


1.21 


1.02 


44 


1.63 


1.13 


1.33 


1.37 


34 


1.21 


1.22 


1.00 


1.18 




1.36 




.50 






2*Dimensional Problems 




48 


1,96 


1.40 


1.00 


1.02 


51 


2.42 


1*32 


1.25 


1.22 


44 


1.92 


1.28 


1.58 


.88 


44 


2.00 


1.35 


1.25 


1.19 


44 


1.83 


1.55 


.88 


.80 


Al 


1.71 


1.33 


1.54 


1.02 




.74 




1.79 






3 -Dimensional Problems 




44 


1.83 


1.S8 


.63 


.77 


,49 


2.04 


1.46 


1.21 


1.25 


,44 


2.13 


1.42 


.71 


.91 


,48 


1.96 


1.52 


1.00 


1.29 


.48 


2.25 


1.36 


.96 


1.08 


.41 


1.71 


1.43 


.92 


1.14 



•90 



•47 



•43 
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table 4.3 

Pencil Concept Hean^ and Standard Deviations 





Proportion 


Number 


Huiober 




Solving 


Inappropriate 


Inappropriate 




Problems 


Choices 


Conclusions 


Concept 


M SD 


M SD 


M SD 



l->Bitaensional Problems 



bong 


.92 


.28 


1.83 


1.52 


1.21 


1.02 


No Eraser 


•58 


• 50 


2.08 


1.28 


1.13 


1.12 


Point 


.92 


.28 


1.42 


1.47 


1.29 


1.20 


Short 


.75 


.44 


1.54 


1.22 


1.17 


1.24 


Eraser 


.83 


.38 


1.50 


1.64 


1.29 


1.33 


Unsharp 


.92 


.28 


1.54 


.83 


1.13 


.99 


F ratio 


3.10* 




<r 

CO 

• 




.10 





2-Dimensional Problems 



Short Eraser 


.71 


.46 


1.50 


1.32 


1.13 


1.42 


Short Unsharp 


.42 


.50 


2.50 


1.47 


1.17 


1.20 


Unsharp Eraser 


.75 


.44 


1.29 


1.40 


1.17 


1.31 


Long No Eraser 


.79 


.41 


1.63 


1.35 


1.00 


1.18 


Long Point 


.71 


•46 


1.58 


1.44 


1,25 


1.36 


Point No Eraser 


.71 


•46 


1.58 


1.28 


1.42 


1.28 


£ ratio 


2.02 




2.22 




.28 





3-Dimen8ional Probl^s 



Long Point Eraser 


.79 


.41 


1.92 


1.47 


.96 


1.00 


Long Unsharp No Eraser 


.67 


.48 


1.75 


1.42 


.58 


.72 


Short Point NO Eraser 


.67 


.48 


1.79 


1.44 


1.13 


1.08 


Short Unsharp No Eraser 


.88 


.34 


1.50 


1.41 


.71 


.86 


Short Point Eraser 


.75 


.44 


1.42 


1.44 


.71 


.81 


Long Unsharp Eraser 


.71 


.46 


1.75 


1.33 


.79 


1.25 



F ratio 



81 



a43 
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represi^iitlng the 'various components o£ problem solving performance with 
a single number. An £*s sunntary score for a problem Is determined as 
follows. Two points are awarded If the ^ solves the problem an J makes 
no inappropriate choices and states no inappropriate conclusions. One 
point is awarded if the S solves the probl^ but makes one or more 
inappropriate choices or states one or more inappropriate conclusions. 

An S receives no points if he dees not solve the problem. Naturally the 

four measures are not independent. 

Consider first the summary measure. Means and standard deviations 
appe&r in Table 4.4. The analysis of variance is described in Table 4.5. 

Order of presentation was the one significant effect. Subjects averaged 

.74 per problem on the first set of materials » .95 on the second set» atid 
1.06 on the final set. 

Table 4.6 contains the means and standard deviations of number of 
solutions to the problems. Since each cell Is represented by a single 
problem which a subject either solved or failed to solve the figures in 
Table 4.6 are actually proportions of £s solving each problem. For this 
reason, incidentally, the means and standard deviations are not independent. 
As can be seen in Table 4.7, order of presentation and number of relevant 
stimulus dimensions both had a significant effect on problem soltuions. 

The average proportion of problems solved was .61 for the first set of 
materials, .77 for the second set and *83 for the third set. An average 
proportion of .80 subjects solved the three l*dlmenslonal problems while 
.70 solved the 2-dlmensional problems and .71 i 
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Table 4.4 

Heans and SDs for the Problem Solving Summary Measure 



Order of Presentation 



Materials 


Number of 
Dimensions 


1st 




2nd 




3rd 




M 


SD 


M 


SD 


M 


SD 




1 


,92 


.61 


.88 


.49 


.94 


.52 


Cards 


2 


.75 


.70 


1.08 


.77 




•67 




3 


.63 


.73 


.98 


.79 


1.21 


.63 




1 


.69 


,59 


.87 


.58 


1.15 


.50 


Cowboys 


2 


,58 


.65 


,90 


.59 


1.06 


.60 




3 


.63 


.67 


1.10 


.69 


.98 


----If, 




1 


.81 


.53 


.90 


.52 


1.02 


.48 


Pencils 


2 


.83 


.73 


.83 


.75 


1.00 


.62 




3 


.83 


,69 


1.02 


.56 


1.02 


.79 
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Table 4.5 



Analysis of Problem Solving Summary Variance 



Source 


df 


MS 


P 


Between Ss 


143 






Group 


2 


• 79 


.76 


^8 within Groups 


141 


1.05 


wiiehitt Ss 

<M«» 


1152 






Order of Presentation (0) 


2 


11.15 


32.39* 


Materials (M) 
(0 X M)* 


2 

2 


.36 

.63 


1.06 

1.84 


H X Ss within Groups 


282 


.34 


Number of Eelevarit Dimenslions (D) 


2 


.09 


.25 


B X Group 


4 


.75 


2.21 


D X £s within Groups 


282 


.34 


0 X D 


4 


.62 


1.87 


H X B 


4 


.24 


.73 


(0 X M)* X D 


4 


.38 


1.16 


H X B X Ss within Groups 


564 


.33 


Total 


1295 







*P < .01 
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Table 4,6 

Means and SCs of Huoiber of Solutions 



Order of Presentation 



1st 



2nd 



Number of 






er|c 



3rd 



IMterials 


Dimensions 


M 


SD 


SI 


SD 


M 


SD 




1 


.77 


.42 


.81 


,39 


.83 


.38 


Cards 


2 


.60 


.49 


.75 


.44 


.83 


.38 




3 


.48 


.50 


.69 


.47 


.85 


.36 




1 


,63 


.49 


.77 


.43 


.94 


.24 


Cowboys 


2 


.50 


.51 


.77 


•42 


.85 


.36 




3 


.52 


.50 


.81 


.39 


.79 


.41 




1 


.75 


.44 


.81 


.39 


.90 


.31 


Pencils 


2 


.60 


.49 


.63 


.49 


.81 


.39 




3 


.67 


.48 


.85 


.36 


.71 


.46 
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Table 4.7 

Analysis of Variance of Huisber of Solutions 



Source 


df 


MS 


F 


Between £s 


143 






Group 


2 


•48 


1.12 


£s within Groups 


141 


*43 




Within Ss 


1152 






Order of fresentation (0) 


2 


5,58 


31.55* 


Haterials (M) 


2 


.03 


.17 


(0 X M)* 


2 


• 21 


1.19 


H X £s within Groups 


282 






Humber of Relevant Oimensions (D) 


2 


1.27 


8.49* 


0 X Group 


4 


• 24 


1.61 


0 X £s within Groups 


282 


.15 




0X0 


4 


• 27 


1.92 


H X 0 


4 


• 15 


1.05 


<0 X M)* X 0 


4 


.27 


1.92 


H X 0 X Ss within Groups 


564 


.14 




Total 


1295 







^p < .01 
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TabXe 4.8 contains means and standard deviations of number of 
inappropriate choices per problem while Table 4.9 summarizes the analysis 
of variance for this measure. Once again, order of presentation had a 
significant effect. The mean number of inappropriate choices per problem 
was 2.09 for the first set of materials, 1.57 for the second set, and 1.45 
for the third set. Type of materials also made a significant difference. 
The mean number of inappropriate choices per problem for the three cowboy 
problems was 1.91* The means were 1.53 and 1.67 for the cards and pencils, 
respectively. 

The means and standard deviations for number of inappropriate 
conclusions appear in Table 4.10. Table 4,11 shows that order of pre-* 
sentatlon, number of relevant stimulus dimensions, and the interaction of 
these two factors were significant. Table 4.12 contains the means entailed 
in these significant effects. The Humber of Relevant Stimulus Dimensions 
X Group interaction was marginally significant, but the means Involved 
in this effect will not be summarized since tbe result is completely 
uninterpretable . 

Discussion . The one factor which had a strong influence was order 
of presentation. This factor had a significant effect cm each of the 
four measures. Evidently children grow more proficient at seising problem 
as their experience with solving problems increases, facilitation 
occurred solely as a function of practice «, There was no training. 

Indeed, there was not even feedback as to the correctness of the child's 
responses, except insofar as feedback was indirectly involved In the 
procedures for administering probl^s. Nonetheless, problem solving per- 
formance improved steadily from the first to the third set of problems* 
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Table 4,8 

Means and SDs of Number of: Inappropriate Choices 



liaterials 


Number of 
Dimensions 




Order of Presentation 






1st 


2nd 


3rd 


M 


SD 


M 


SD 


M 


SD 




1 


1.58 


1.11 


1,58 


1.11 


1.39 


1.11 


Cards 


2 


1.94 


1.41 


1.25 


1.38 


1.08 


1.16 






2,27 


1.28 


1.56 


1.50 


1.16 


1.33 




1 


2.31 


1.29 


1,77 


1.31 


1.23 


1.13 


Cowbcj'^s 


2 


2.54 


1.35 


1.71 


1.29 


1.67 


1.31 




3 


2.54 


1.22 


1.58 


1,50 


1.83 


1,47 




1 


1.69 


1.27 


1.58 


1.30 


1.69 


1.49 


Pencils 


2 


1.89 


1.52 


1.67 


1.42 


1.48 


1.27 




3 


2.06 


1.37 


1.45 


1.30 


1.54 


1.49 






er|c 
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Table 4,9 

Analysis of Variance of Number of Inappropriate Choices 



Source 


df 


m 


F 


Between 


143 






Croup 


2 


6*44 


1.28 


Ss within Croups 


141 


5.04 




Within Ss 


1152 






Order ©f Presentation (0) 


2 


50.06 


35.74* 


Hateriais (M) 


2 


14.95 


10,68* 


(0 X M)* 


2 


1.40 


1.00 


H X ^s within Groups 


282 


1.40 




Number of Relevant Dimensions (D) 


2 


2.07 


1.57 


D X Croup 


4 


2.28 


1,73 


D X Ss within Groups 


282 


1.32 




0 X D 


4 


2.78 


2.06 


H X D 


4 


1.26 


.93 


<0 X H)* X D 


4 


1.24 


.93 


H X 0 X £s within Groups 


564 


1,35 




Total 


1295 







*p < .01 
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Table 4.10 

Means and SDs of Number of Inappropriate Conclusions 



Materials 


Number of 
Dimensions 




Order of Presentation 




1st 


2nd 


3rd 


H 


SD 


M 


SD 


M 


SD 




1 


.79 


1.05 


1.58 


1.47 


1.13 


1.20 


Cards 


2 


1.20 


1.32 


.88 


1.18 


.79 


1.18 




3 


1.10 


1.34 


1.02 


1.14 


.50 


.62 




1 


1.02 


1.00 


1.55 


1.40 


.69 


.78 


Cowboys 


2 


1.50 


1.17 


1.25 


.96 


1.00 


.97 




3 


1.25 


1.31 


.75 


.98 


.71 


.85 




1 


1.23 


1.15 


1.56 


1,24 


.81 


.89 


Pencils 


2 


1.38 


1.27 


1.48 


1.44 


.71^ 






3 


.96 


1.11 


.81 


.94 ^ 




• 83 
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Table 4.11 

Analysis of Variance of Nuciber of Inappropriate Conclusions 



Source 


df 


HS 


P 


Between Ss 

mm 


143 






Group 


2 


.03 


.01 


^s within Groups 


141 


2.52 




Within £s 


1152 






% 

Order of Presentation (0) 


2 


23.86 


21.39** 


Materials (H) 


2 


.75 


.67 


(0 X ny 


2 


2.01 


1.80_ 


H X £s within Groups 


282 


1,12 




Nuiid>er of Relevant Oiinensions (0) 


2 


11.05 


8.79** 


D X Group 


4 


3.18 


2.53* 


D X £s within Groups 


282 


1.26 




0 X D 


4 


6.79 


6.70** 


H X D 


4 


1.78 


1.75 


(0 X M)* X 0 


4 


1.22 


1,20 


H X D X £s within Groups 


564 


1.01 




Total 


1295 







*p < ,05 

**p • 01 
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Table 4.12 

Mean Number of Inappropriate Gonelijslona Per Problem as 
a Function of Order of Presentation and 



Nuod»er of Relevant Stimulus Dimensions 


Number 

of 

Dimensions 




Order 




1 


2 


3 


M 


1 


1.01 


1.56 


.88 


1.15 


2 


1.36 


1.20 


.83 


1.13 


3 


1.10 


.86 


.63 


.86 


M 


1.16 


1.21 


,78 
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Research with first graders reported in Chapter 6 showed that there 
is a definite limit to the amount of improvement which will result from 
unguided practice alone. IJhile it is impossible to estimate how close to 
asymptote the fourth graders in the pri^jent experiment were by the end 
of their third set of three problems, it is worth noting that performance 
gain was negatively accelerated. That is, with respect to the summary 
measure, number of solutions, and number of inappropriate choices (but 
not number of inappropriate conclusions) there was substantially greater 
improvement from the first to the second set of problems than from the 
second to the third. 

Tentatively, the significant effect of number of relevant stimulus 
dimensions on number of so^Aitions and on number of inappropriate conclusions 
can be attributed to the control which positive instances exercise over 
conclusion drawing behavior and conclusion stating behavior. Subjects 
stated fex^er inappropriate conclusions on 3-dimensional problems than they 
did on 1“ and 2-dimensional problems. And, fewer 3-dimensional problems 
than 1- or 2-dlmensional problems x^ere solved, an £ solves a problem 

he must by definition state a conclusion. Thus, less conclusion-stating 
behavior, either appropriate or inappropriate, \ms emitted on 3-dlmensional 
problems than on 1- and 2-dimensional problems. In a 3-dlmensional problem 
formed with a set of materials representing three stimulus dimensions 
each of which takes on txro values, there is only one positive instance, 
the focus instance designated by £• Hone of the instances chosen by ^ 
in the course of x-iork on a S-dimcnsicnal problem could be positive. 

The argument is that Ss tend to drax7 conclusions by naming the common 
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elements of positive instances, f^en no positive Instances are encountered, 
conclusion stating behavior is inhibited « 

The effect of type of materials on number of inappropriate choices 
is attributable to the greater frequency of such choices id.th cowboy 
problems. The author and his associates have often observed that the 
story line employed with the cowboy materials interferes with problem 
solving behavior. A child will insist that a "friend of the sheriff* 
must ride a horse or must carry a rifle. Possibly the thematic characterise 
ties of the cowboy task led to Interference; though if this is the ease 
it is not clear why number of inappropriate choices was the only measure 
affected. 



Aptitude factors and problem solving 

Interpreta tion of factors . The correlation matrix appears in 
Appendix II. Table 4.13 contains the rotated factor loadings. The seven 
rotated factors accounted for 63.4% of the total variance. The com- 
munalities of the Individual terts and an estimate, not always an appropriate 
one, of the reliabilities of the tests appear in Table 4.14. The inter- 
pretation of factors is given below. 

I. Verbal Compr*ehens ion . All of the tests loading highly on this factor 
have verbal content. It is clearly Verbal Comprehension. 

II* Speed . This factor is difficult to interpret. Loaded highly are 
the tests which were expected to define Associative Memory and Number 
Facility as well as Perceptual Speed. Speed seems to be the common 
element. First of all, the two Perceptual Speed tests (tests #5 and #13) 
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Table 4.13 

Varimax Factor Matrix 

I II III IV V VI VII 



1 


.17 


.75 


-.05 


2 


.65 


.46 


.21 


3 


.29 


.53 


.41 


4 


.15 


.17 


.25 


5 


.11 


.65 


.00 


6 


.79 


.21 


.23 


1 


.60 


-.01 


.00 


8 


.39 


.22 


.41 


9 


.17 


.43 


.24 


10 


.16 


.23 


-.02 


11 


.23 


.09 


.48 


12 


.56 


.36 


.44 


13 


.32 


.42 


,23 


14 


.58 


.18 


.23 


15 


.26 


.11 


.35 


16 


.04 


-.09 


.68 


17 


.15 


.23 


.17 


18 


.02 


-.21 


.11 


19 


.74 


.06 


-.00 


20 


.22 


,16 


.62 


21 


.16 


.05 


-.09 


22 


.46 


.13 


.01 


23 


.06 


.12 


-.01 


24 


-.04 


.09 


.15 


Percent 

CoiiBDon 

Variance 


23.0 


15.7 


14.0 



.09 


.31 


-.04 


-.06 


.09 


.11 


-.07 


-.01 


.07 


.18 


.29 


.17 


.12 


.71 


-.07 


-.07 


.22 


-.07 


.07 


.09 


.11 


.09 


.11 


.09 


.00 


.45 


.09 


.14 


-.03 


.28 


.32 


.28 


.16 


.13 


,36 


.24 


.05 


.70 


.27 


.13 


-.12 


.29 


.45 


.06 


-.01 


,12 


.19 


.07 


.13 


.19 


.35 


.15 


.27 


.19 


.31 


.12 


.68 


-.10 


.09 


.05 


.26 


.12 


-.06 


- .02 


.70 


.18 


,11 


.08 


.27 


.46 


—.14 


.43 


.20 


,03 


.15 


-.02 


.19 


-.03 


-.03 


.31 


.18 


-.03 


,84 


-.08 


.10 


-.08 


.05 


.60 


.74 


.11 


.06 


.18 


.14 


.11 


.02 


.81 


13.2 


12.5 


10.9 


10.6 
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Table 4,14 

Estinated Reliabilities and CooBiunalities of the 
Twenty-four Aptitude Tests 



Test Number 


Procedure for 
Estimating 
Reliability* 


Estimated 

Reliability 


Gofsmunalities 


1 


2 


• 56 


.71 


2 


2 


•82 


•71 


3 


2 


*90 


.69 


4 


1 


.55 


•64 


5 


2 


.70 


.51 


6 


1 


• 89 


.76 


7 


1 


• 65 


.59 


8 


1 


.82 


.63 


9 


1 


.93 


.50 


10 


3 


.86 


.65 


11 


3 


70 


.60 


12 


3 


.88 


.69 


13 


1 


.92** 


• 52 


14 


1 


.94 


.64 


15 


4 


.72 


.69 


16 


4 


.37 


.56 


17 


1 


.77 


.65 


18 


1 


.54 


.55 


19 


1 


•68 


•62 


20 


4 


.79 


.59 


21 


4 


•66 


.77 


22 


1 


.71 


.60 


23 


4 


• 87 


.61 


24 


4 


.51 


• 72 



There were four computational procedures: 



(1) odd-even correlation stepped up by Spearman-Brown formula » 

(2) parallel form correlation stepped up by Spearman-Brown 
formula, 

(3) Horst formula for unequal length parts, 

(4) items were intercorrelated, then r to z (Fisher) 
transformations were made for each unique correlation. 

The average z was transformed to r. The Spearman-Brown 
formula was then applied to the r. 

This is to be regarded as an inaccurate upper bound estimate* 
The misapplication of a formula by Gulliksen gives an inaccurate 
lower bound estimate of *25* 
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did load highly* Second, it is knotm that tests involving routine 
aritknetic problems sometimes do load on the Perceptual Speed factor rather 
than defining a separate factor* With regard to tests #1 and #2, which 
supposedly represented Associative Memory, these were intended for adults 
but were used with children in the present study* Scores were low* It 
is not unreasonable to suppose that those who scored high did so because 
they worked quickly. 

Ill* Reasoning * This factor is called Reasoning because of the loadings 
of tests #3, #8, #11, and #12; however, the high loadings of teste #16 
and #20 make Its status ambiguous* 

IV. Ideational Fluency. All three tests of Ideational fluency loaded 
highly on Factor IV* 

V* Spatial Orientation . The two tests with the highest loadings on this 
factor were both tests of spatial orientation* The other tests with 
moderate to high loadings all had flgural as opposed to verbal content. 

VI. Flgural Adaptive Flexibility * This factor was so named because the 
one test with a very high loading was the match stick puzzles test* 

VII. Originality * All three originality scales loaded on this factor. 
Relationship of aptitude factors to problem solving performance * 

As a service to the cooperating schools aptitude factor scores, correctly 
computed (Glass and Maguire, 1966), were furnished in percentile rank 
form (Willis and Anderson, 1965). These scores were intercorrelated to 
be sure that the conversion to percentile ranks had not introduced noise* 
All of the entries were near zetci* 
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Next, correlations between factor scores and problem solving 
performance were computed. Relationships with all of the problem 
solving measures were studied, but only the analysis Involving the 
summary measure will be reported here. This Is logically the single best 
representative of problem solving performance, the most comprehensive 
measure, and probably the most reliable measure. Then too, as will become 
apparent in a moment, nothing very striking was discovered, so there 
was no point to Including all the figures. 

The fact that different subjects received different problems and 
the fact that many of those who received the same problems received them 
in different orders were potentially serious difficulties for the 
correlational phase of the analysis. The situation is comparable to 
that which would exist if several different forms of an achievement test 
were given. If the data were simply pooled without regard to test form, 
the correlations of achievement with other variables might be attenuated. 
In order to gauge the extent of the attenuation, both wlthin-group 
correlations and pooled-data correlations were computed. 

Number of relevant dimensions was collapsed. Each £ then had three 
scores, one for his first three problems, one for his second three 
problems, and one for his third three problems. For the computation of 
the wlthln-group correlation,, the Ss were then divided into the 18 
groups defined by Sequence Group and Problem Subgroup. The variance- 
covariance matrix, involving the seven aptitude factor scores and the 
three problem solving summary scores, was computed for each group. The 
matrices were summed, and the withln-group correlations were computed 
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from the total matrix. Table 4.15A contains the withln-gronp correlations 
between the aptitude factors and problem-solving performance. Pooled- 
data correlations appear in Table 4.15B. Included is the multiple 
correlation, R, of the aptitude factor scores with the measure of problem 
solving performance. The reliability estimate, rr, is the highest 
correlation that a given task showed with the other two tasks. 

None of the correlations appearing in Tables 4.15A and 4.15B is 
very large. The apparent difficulty is the lack of reliability of the 
problem solving criterion. An alternative possibility is that the 
aptitude factors interact with type of materials or number of relevant 
stimulus dimensions, two factors which were collapsed for the correlational 
analysis. If, for example, a certain factor were positively correlated 
with performance on 1-diraensional problems but negatively correlated 
with performance on 3-dimensional problems the net relationship would be 
near zero. The data were reanalyzed by task and by number of relevant 
stimulus dimensions. There were no indications of Interactions between 
these task factors and the aptitude factors. 

It does seem, then, that at least one reason for small relationships 
was the low reliability of the problem solving criterion. Anderson 
(1964) and Walsh (1963), in studies reviewed in Chapter 3, reported higher 
reliabilities for a summary measure of problem solving than weis obtained 
here. In both of the previous studies the child performed on two problems 
involving the same number of stimulus dimensions and the same materials 
at one sitting. Perhaps this made the difference. Also, the summary 
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Table 4.15A 

Relatlonsl'ilps Between Aptitude Factors and Problem Solving 
Performance. A. Wlthln-Group Correlations 



ProbleiP Factor 



Solving 

Performance 


I 


II 


III 


IV 


V 


VI 


VII 


R 


rr 


First task 


.03 


.03 


.06 


-.07 


.28 


.24 


-.09 


.39 


. 38 


Second task 


.06 


.16 


* 

o 

o 


O 

. 

1 


.19 


.29 


.05 


.39 


.47 



Third task 



07 



01 ,11 



18 



16 .25 .19 .41 .47 
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Table 4.15B 

Relationships Between Aptitude Factors and Problem Solving 
Performance. B. Pooled-data Correlations 



Problem 

Solving 

Performance 


Factor 

I II III IV V VI VII R rr 


First task 


-.02 .01 .10 -.09 .22 .24 -.03 .35 .39 


Second task 


.04 .17 .04 -.04 .16 .23 .12 .36 .46 


Third task 


.02 .08 .09 .13 .13 .23 .22 .39 .46 
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measure esiployed in the correlational analysis of the data from the 
previous studies was slightly different and, perhaps, somewhat more 
reliable than the one used in this study. 

Two factors showed modest but significant correlations with problem 
solving performance, namely Spatial Orientation and Figural Adaptive 
Flexibility. Both of these factors entail skill at dealing with spatial 
or figural as opposed to verbal material. In a typical test of Spatial 
Orientation, the ^ must select the one alternative from among several 
which is identical to a sample except for a clockwise or counterclockwise 
rotation. None of the problems involved precisely this skill; however, if 
the analysis presented in Chapter 1 is correct, a perhaps related skill 
is important for solving concept attainment problems. I^en selecting 
instances and/or when drawing conclusions, the £ must discriminate a 
set of instances or potential instances in terms of one stimulus dimension 
while ignoring variations along other stimulus dimensions. 

Figural Adaptive Flexibility, the second factor to show moderate 
correlations with problem solving performance, was defined in the present 
study primarily by a match stick puzsles test. On this test, the £ is 
presented \<rith complex configurations and asked, for example, to ‘take 
away two sticks and leave three triangles." Aside from the fact that 
both involve spatial configurations, the match stick puzzles test and 
the concept attainment problems do not share obvious characteristics. 

A relationship between Memory and problem solving performance had 
been expected. This expectation was based on the analysis presented 
in Chapter 1 (which received some indirect support in the experiment 
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reported In Chapter 5). Unfortunately, a separate memory factor did not 
appear. The two tests which were supposed to define a memory factor 
coalesced with several other tests to produce a factor which was 
interpreted as Speed. Assuming there is some memory component to this 
factor, the correlations are very low and therefore not supportive of 
the hypothesis. Memory was expected to play a larger role in performance 
with the pencils than with the cards and cowboys, because the pencils 
are shuffled after each problem whereas the spatial arrangement remains 
the same during each problem for the other materials. For what it is 
worth, factor II correlated .18 with pencil performance and only *05 
with card and cowboy performance. A further difficulty is that what the 
psychometiclan calls Associative Memory is a very impure measure of 
memory since it does not exclude learning. Memory span measures, which 
were not included in this study, would have been more relevant to the 
hypothesis. 



Summary and conclusions 

The chief conclusions of the study reported in this chapter are 
as follows: 

1. Given a specified set of materials and a specified number of 
relevant stimulus dimensions, the particular concept to be attained 
evidently has little effect on children’s problem solving behavior. There 
were only threeualgnif leant (a * .05) effects in 27 one-way analyses of 
variance. Each analysis involved six groups each of which received 
a different concepts There was no apparent pattern to the three 
significant effects that were obtained. 
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2. Order of presentation of problem sets had a strong effect on all 
four dependent variables. Problem solving performance improved from the 
first to the third set of three problems. 

3. One-dimensional problems were easier to solve than either 2- or 
3«dimens ional problems . 

4* Type of materials affected only number of logically inappropriate 
choices of instances per probxem. There were more such choices during 
cowboy problems than during card or pencil problems, perhaps because the 
‘‘story line" employed with the cowboys led to interfering associations 
(see Chapter 6). 

5. There were more inappropriate conclusions. Indeed, more verbal 
behavior both appropriate and inappropriate, during 3-dim^sional problems 
than during 1- and 2-dimensional problems. This was interpreted to mean 
that positive Instances play a role in controlling conclusion-drawing 

and conclusion-stating behavior (see Chapter 1 and Chapter 5). Since 
none of the instances, except the focus Instance, which the child 
encounters during a 3-dimensional problem is positive, verbal behavior 
is therefore inhibited. 

6. Seven of the ten expected factors materialized in the components 

analysis of the intercorrelation among the aptitude tests. The rotated 
factors were named as follows: 1. Verbal Comprehension, II. Speed, III. 

Reasoning, IV. Ideational Fluency, V. Spatial Orientation, VI* Figural 
Adaptive Flexibility, VII. Originality. 



7. Two aptitude factors — Spatial Orientation and Figural Adaptive 
Flexibility— showed modest correlations with problem solving performance 
Evidently skill in dealing with spatial configuifations plays a role in 



performance on concept attainment problems. 
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CHAPTER 5 

Effects of the Availability of Concrete Stimulus 
Objects on Children's Problem Solving^ 



According to Piaget a child at the "stage of concrete operations," 
which is believed to occur from roughly seven to eleven years of age, will 
be able to solve many kinds of problems so long as these involve 
manipulation of concrete objects and reasoning about concrete objects 
which are physically present. However, the child at the stage of concrete 
operations is believed to be unable to engage in many forms of "abstract 
thinking" particularly those entailed in logical operations and inductive 
inquiry. The latter capabilities are believed to arise at the "stage 
of formal operations" which, it is alleged, develops during the period 
from about eleven to fourteen years of age. According to Xnhelder and 
Piaget (1958, p. 335) 

The adolescent superimposes propositional logic on the 
logic of classes and relations. Thus, he gradually 
structures a formal mechanism (reaching an equilibrium point 
at about 14-15 years) wh?ch is based on both the lattice 
structure and the group of four transformations. This new 
integration allows him to bring inversion and reciprocity 
together into a single whole. As a result, he comes to 
control. . .hypo thetico-deductive reasoning and experimental 
proof based on the variation of a single factor with 
the others held constant (all other things being equal) .... 

Anderson (1964, 1965) developed a training procedure which 
successfully taught first graders to solve concept attainment problems « 



^liss Carla Cucciatti executed the research described in this 
chapter during her term as an Undergraduate National Science Foundation 
Fellow. Hiss Cucciatti drafted the first report of the experiment. 

The research was designed by the author who also wrote this report. 
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Given an instance of a phenomenon the majority of the children who 
received training were able to discover the necessary and sufficient 
conditions for the occurrence of the phenomenon. In the course of a 
problem most of the children performed few inappropriate eKperiments 
and seldom stated false or Incomplete conclusions. The behavior of 
the majority of the children conformed to the strategy of varying each 
factor in succession while holding all other factors constant. 

Chapter 6 contains new evidence that first graders can be taught to 
solve concept attainment problems at a fairly high level of proficiency. 
Contrary to what one would expect on the basis of Piaget’s work, first graders 
learned *‘hypothetico-deduccive reasoning and experimental proof based 
on the variation of a single factor with the others held constant.’* 

In the earlier experiment (Anderson, 1964, 1965) the children were 
able to solve problems involving new materials which they had not 
encountered during training. However, a high level of problem solving 
performance was maintained only with materials consisting of collections 
of concrete objects physically arrayed in front of the child* Children 
who received training did only slightly (and not significantly) better 
than untrained controls on a pendulum problem and two chemical problems. 

Ce the chemical problems will be described for illustration. 

Materials consisted of a four-ounce amber bottle, a watch glass, and a 
set of five one— ounce dropping bottles labeled A, B, C, D, and E. ic.ach 
bottle contained a colorless orderless liquid. Two of the botfles 
contained water. The other three contained, respectively, dilute 
solutions of sulphuric acid, hydrogen peroxide, and potassium iodide. 
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The problem was to find "which bottles you have to use to get yellow." 

The concept to be attained was that bottles B, G, and D were necessary. 
The focus Instance was the demonstration that when drops from each of 
the five bottles were placed in the amber jar and the contents were 
poured on the watch glass, the liquid was yellow. The child was 
allowed to try a maximum of ten combinations of bottles in the attempt 
to solve the problem. 

There are several differences between the chemical problem which 
has just been described and problems that involve collections of 
concrete objects. Note first, though, that the problems are isomorphic 
at a certain level of discourse. For both types, the optimum strategy 
for solution is to study each potentially relevant variable in succession 
while holding all other variables constant. One salient difference is 
that in the chemical problem the child must create or produce the 
Instances needed to test the relevance of factors. It is the combination 
of bottles that constitutes an Instance in the chemical problem, whereas 
in, say, a cowboy problem each concrete stimulus object (e.g. the cowboy 
on a horse with a hat but no rifle) is an instance. The chemical problem 
could be made to resemble a cowboy problem if the child were provided 
with thirty-two bottles, appropriately labeled, each of which contained 
one of the thirty-two possible combinations of five Ingredients each 
either present or absent. Conversely a cowboy problem could be made to 
resemble the chemical problem if the child were provided with a cowboy. 
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a horse, a hat, and a rifle and directed to construct the combination 
he wished to learn about. The same transformations were illustrated 
earlier (p. 12-13) with the pattern vision example and the card array. 

Piaget has reasoned that skill in combining materials to produce 
instances that are relevant for testing hypotheses entails the capacity 
to 'conceive combinatorial possibilities,'* l«iile hs might be able to 
select appropriately from already-formed combinations arrayed in his 
visual field, Piaget would not expect a child at the stage of concrete 
operations to be able to conceive, and therefore to construct, a combina- 
tion appropriate to test an hypothesis. Herein lies one possible 
explanation of the failure of the first graders in the original experiment 
to do well on the chemical problems. 

An alternative explanation, which the author favors, is that the 
physical presence of already-formed instances facilitates problem 
solving performance because the child is helped to remember what he has 
learned. This hypothesis la based on the analysis of the concept 
attainment problem presented in Chapter 1 (see also Chapter 6) and on 
a great deal of observation of children attempting to solve problems. 

A child working on a card or a cowboy problem will sometimes spontaneously 
hold his fingers on each of the instances he selects. Occasionally a 
child will even use the fingers of one hand to mark positive Instances 
and the fingers of the other hand to mark negative instances. This sort 
of behavior is much more frequent on pencil problems. Many children 
are observed to place the pencils into two piles spontaneously, one 
for those that "show the secret," the other for those that do not. 
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The evident function of marking the instances that have already been 
chosen is to enable the child to reSBiember them. 

At one point, in order to make pencil problems more comparable to 
problems arranged with other materials, children were prohibited from 
handling the pencils. A deterioration in performance was observed as 
a result. Several children were instructed not to touch the pencils. 
Several others were expressly directed to sort the positive instances 
into one pile and the negative instances into another. The former children 
performed better. 

There are indications that a system of marking the instances in 
some way as they are selected facilitates performance, presumably 
because memory is thereby improved. On the other hand, observation of 
children attempting to solve problems gives little indication that 
choosing logically appropriate Instances is difficult for seven- to 
eleven-year-olds. This impression is supported by an analysis of the 
1296 protocols collected during the experiment reported in Chapter 4, 

At his first choice there are seven instances the child could choose. 

The procedures effectively rule out the possibility that the child will 
choose the eighth instance, which is the focus. In fact the focus 
Instance was not a first choice in any of the 1296 protocols. Three of 
the seven instances are logically appropriate; that is, three of the 
instances are different from the focus instance in terms of one factor 
and the same in terms of all other factors. Consequently, by chance alone 
a child would select a log'^cally appropriate instance at his first 
choice 42.5% of the time. The observed frequency of logically appropriate 
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first choices was 93,3%. Only first choices were considered because 
later choices could be affected by forgetting and because calculation 
of the probabilities of logically appropriate choices by chance alone 
become complicated for later Instances. 

In the present experiment, children worked pencil problimns either 
*“on the board*' or "in the head.'* Under the "on the board" condition the 
eight pencils were physically arrayed in front of the child, whereas 
they were not in view under the "in the head" condition. The second 
factor was whether or not the Instances selected by the child were made 
available and sorted into piles, or ^marked," to make a physical record 
of choices. If children in the seven to eleven year age range are 
unable to "conceive combinatorial possibilities," then the ‘'on the board" 
condition should lead to better performance than the 'in the head" 
condition. If, on the other hand, the chief value of having available 
instances in the of concrete stimulus objects is to facilitate 
memory, the presence of "markers" will be the important factor. The 
critical comparison for differentiating the two hypotheses is between 
"in the head" with markers and ‘*in the head" without markers. The 
memory hypothesis predicts only a slight facilitation from the avail- 
ability of markers when the Instances are physically arrayed in front 
of the child. The facilitation is expected to be only slight because 
the child can remember the instances by noting their position in 
the array; he need not verbally encode the instances to r^^ber th<ma 
(see pp. 24-25). When the problem is worked in the head, the child 
must verbally encode the Instances to remember them unless markers are 
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available. Verbal encoding is probably a more difficult process thab 
noticing the position of an Instance and verbally encoded material is 
probably more vulnerable to interference. Thus, according to the 
memory hypothesis, performance will be poor only when the problem is 
worked in the head and no markers are available. The Fiagetlan hypothesis, 
in contrasts, predicts poor performance for In-the-aead problems whether 
or not markers are available. 



Method 

Styrf>iect.s_. The Sp were 16 boys and 8 girls. At the time of the study, 
the Ss were enrolled in a summer school in a midwestem community of 
30,000 in which a large state university is located o There were 15 
Sp who were entering the fourth grade the next fall and 9 who were entering 
the third grade. The £s were randomly assigned to conditions. 

Procedure . The procedure was described in Chapter 2 but since 
procedure Is critical for Interpreting the preset experiment it will 
be summer Ixed again here. The materials consisted of eight pencils 
displaying three attributes: length (6 in. or 2 ine)^ sharpened or 

unsharpened; and presence or absence of an eraser. The female E worked 
individually with ^s. An ^'s participation in the coeperlment was 
completed in a single session of from 15 to 40 min. in length. 

The ^8 received an orientation task prior to attempting problems. 

In this task all of the pencils were arrayed on a table in front of the 
The E named a concept and the £ was required to point to all of the 
positive instances of the concept. A list of 24 concepts**-consisting 
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of six 1-dlmenslonal concepts, six ?,-dlmensional concepts, six 3- 
dimensional, and six repetitions of the 0-dimensional concept— ‘were 
treated in this manner. Included the concepts that would later 
have to be attained in order to solve problems. After each concept, ^ 
shuffled the pencils. When ^ failed to identify the positive instances 
of a concept, he was prompted to make a correct response and the concept 
was repeated after an interval until an unprompted correct response 
was made. 

Each ^ received a 1-dimensional, a 2-dimensional, and a S-dimensional 
problem. The specific concepts were randomly selected for each S 
independently of other Ss from among the six concepts of each type 
included in the orientation task. The three problems were presented in 
counterbalanced orders according to a Latin square. Before each problem, 

E read the standard instructions modified so that the £ was directed to 
name the pencil he wished to learn about instead of pointing to it. The 
^s were not permitted to touch the pencils under any of the conditions. 

The ^ exhibited one pencil and indicated that it “showed the secret.*' 

The ^ named pencils and attempted to state the concept. A series of 
standardized prompts, described in Chapter 2, was used to keep £ 
performing. A problem was terminated when the child refused £0 continue, 
when he selected six Instances without solving the problem, o^^ when he 
solved the problem by selecting a series of instances and stating a 
concept such that the instances implied the concept and no other. The 
E wrote protocols which were scored in the manner detailra in Chanter 
2. There were three dependent variables; number of solutions, number of 
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Inappropriate choices, and nianber of Inappropriate conclusions.^ 

Design . Half of the £s received the On the Board condition in 
which the pencils were arrayed on a table in front of the The pencils 
were shuffled before each problem under this condition. The remainder 
of the £s received the In the Head condition in which the pencils were 
concealed from the child's view during the course of the problem. The 
foctEs instance, however, was placed on the table where it remained 
throughout the problaa. Within both the On the Board and In the Head 
conditions » Imlf of the £s received Markers. That is, as the child 
named a pencil, the ^ selected the pencil and placed it in a designated 
position on the table. Positive Instances, includ ag the focus instance, 
were placed near the ^*s left hand. Negative instances were placed 
near his right hand. Under the No Marker condition, the pencils were 
not placed into piles in the manner just described. The treatments 
entailed under each of the conditions are summarized in Fig. 5.1. 

The experimental conditions involved between<-subject factors. 

Included also were two within^-subject factors p mmbet of relevant stimulus 
dimensions, and order of presentation. An incomplete analysis of 
variance was calculated since degrees of freedom were at a premium. 

Higher order interactions were pooled with error variance. The 
Dimension X Order Interaction was also pooled with error since this 
interaction was thoroughly studied in the experiment reported in Chapter 4 



2The gmiomary measure had not been developed when these data were 
analyzed and the data has not yet been reanalyzed. 
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Condition 


Description of Treatment 


On the Board-Marker 


The eight pencils are arrayed in a dis- 
orderly fashion In front of the The E 

places each positive instance named by the 
^ near £'s left hand, and each negative 
Instance near £*s right hand. 


On the Board-No Marker 


The eight pencils are arrayed in a 
disorderly fashion in front of the 
At the beginning of the problem E places 
the focus instance near £'s left hand, 
otherwise the arrangement of the pencils 
is not disturbed during the course of 
the problem. 


In the Head-Marker 


At the beginning of the problem E places 
the focus instance on the table near £^s 
left hand. The selects each pencil 
named by ^ from a box hidden from ^'s 
viex^. The places these pencils In 
piles, one for positive instances, near 
£'s left hand^ and one for negative 
instances, nei 2 d^^ ^'s right hand. 


In the Head-N6 Marker 


At the beginning of the problem, E 
places the focus instance on the table 
near ^'s left hand. No other pencils 
are displayed during the course of the 
problem. 



Fig. 5.1. Description of treatment under each experimental condition 
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Results 

Table 5.1 contains the means and standard deviations per problem 
for the three dependent variables as a function of experimental condition 
Analyses of variance are summarized in Tables 5.2, 5.3 and 5.4. 

There was a significant interaction between the factors defining 
the experimental conditions with respect to number of inappropriate 
choices. As can be seen in Table 5.1, the interaction appeared because 
of the large number of inappropriate choices under the In the Head- 
No Marker condition, labile no other effects involving the experimental 
conditions were significant in the analyses of variance, the preplanned 
comparisons of the In the Head-Marker condition and In the Head-No 
Marker condition were made nonetheless using two-tailed t tests 
(a « .05, df * 10). There were significant differences in the direction 
expected on the basis of the memory hypothesis for number of solutions 
* 2.91) and number of inappropriate choices of instances * 3,06) 
but not for number of inappropriate conclusions (jt » .33). 

There were significant differences in number of inappropriate 
conclusions as a function of the number of relevant stimulus dimensions 
defining the concept to be attained. The means per problem were 1.42, 
1,25, and ,71 for the 1-, 20, and 3-dimensional problems, respectively. 
This result parallels the result obtained in the large experiment 
reported in Chapter 4. 
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Table 5.1 

Means and SDs Per Problem for Each Measure 



Condition 


Number of 
Solutions 


Number of 
Inappropriate 
Choices 


Number of 
Inappropriate 
Conclusions 


M 


SD 


M 


SD 


M 


SD 


On the Board-Markers 


.50 


.35 


2.44 


.78 


U28 


.77 


On the Board-No Markers 


,44 


.40 


2,33 


1.17 


1.06 


,77 


In the Head-Markers 


.50 


.23 


2.39 


.90 


.94 


. 68 


In the Head-No Markers 


.11 


.17 


3.94. 


,85 


1.06 


• 
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Table 5.2 

Analysis of Variance of Number of Solutions 



Source 



df MS F 



Between £s 



On the Board vs In the Head (P) 


1 


.50 


1.70 


Markers vs No Markers (H) 


1 


.89 


3.02 


P X M 


1 


.50 


1.70 


within groups 


20 


.29 




Within 








Dimensions (D) 


2 


.10 


.45 


D X P 


2 


.04 


.20 


D X M 


2 


.35 


1.61 


Order (0) 


2 


.10 


.45 


0 X P 


2 


.04 


.20 


0 X M 


2 


.18 


.84 



Residual 



36 .21 



Total 



71 
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Table 5.3 

Analysis of ¥arianc© of Humber of Logically 
Inappropriate Choices of Instances 





Source 




d£ 


MS F 



Between Ss 



On the Board vs In the Head (P) 


1 


10.89 


4,11 


Markers vs Ho Markers (M) 


1 


9.39 


3.34* 


P K M 


1 


12. fO 


4,72 


^s within groups 


20 


2.65 




Within Ss 








Oimensiows (B) 


2 


.72 


,69 


D X P 


2 


.06 


.05 


D X M 


2 


1.06 


1.00 


Order (0) 


2 


1.35 


1.28 


0 K P 


2 


.18 


.17 


(L* I M 


2 


1.01 


.96 


SesMaal 


36 


1.05 




Total 


71 







* 

£ < 



.05 
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Table 5.4 

Analysis of Variance of Number of Logically 
Inappropriate Conclusions 



Source 


df 


MS 


F 


Between 








On the Boakd In the Head (P) 


1 


.50 


.35 


Markers vs Ne Markers (M) 


1 


,06 


.04 


P X M 


1 


.50 


.35 


within groups 


20 


1.42 




Within £s 








Dimensions (D) 


2 


4,04 


4.21 


D X P 


2 


.29 


.30 


D X M 


2 


.51 


.54 


Order (0) 


2 


3.04 


3.17 


0 X P 


2 


.04 


.04 


0 X M 


2 


.43 


.45 


Residual 


36 


.96 




Total 









* 

£ 



.05 





Anderson 



123 



/ Discnasion 

The results of l|his experiment clearly support the hypothesis 

1 

that the presence of instances in the form of concrete stimulus objects 
facilitates problem sol^^ing performance of eight- and nine-year-olds 
by serving as a memory aid. There was no support for the hypothesis 
that the absence of concrete objects results in a deterioration in 
performance because children of this age are unable to conceive 
combinatorial possibilities and are, tharefore, unable to construct 
(e»g, name the elements of) the instances logically required to solve 
problems. These conclusions were further supported in a subsidiary 
analysis of the data, 

A rationale was presented in Chapter 2 for the subdivision of total 
number of inappropriate choices of instances into inefficient Instances, 
redundant Instances and repetitious Instances, An inefficient Instance 
on the average yields less than the maximum attainable amount of 
information. Operationally, an Inefficient Instance is different from 
the focus instance, or other positive instance, along more than one 
dimension, A redundant Instance logically allows only a conclusion 
implied by previously-chosen instances while a repetitious instance 
exactly duplicates a previous Instance, 

Inefficient and redundant choices will occur when behavior is not 
under the control of the stimuli embodying the logical constraints 
in the problem. These logical constraints entail the “'conception'* 
of the instances the outcome of xi^hich, positive or negative, will 
control conclusion-stating behavior. In other words the problem 
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solirer must make responses that produce stimuli that evoke correct 
conclusions. Inefficient and redundant choices ^ r^hich cannot logically 
lead to correct conclusions, should occur mainly because the problem 



solver cannot ’'conceive” appropriate instances, though late in the 
problem they might occur because he could not remember his previous 
choices e Presumably the only reason a problem solver would repeat 
an instance would be if he could not remember that he had previously 
chosen the iaetance or, if he remembered that he had chosen it, that 
he could not remember whether it did or did not ”show the secret* 



If the conception-of-eombinatorial~possibilities hypothesis is correct, 
the In the Head conditions should lead to more inefficient and redundant 
choices. The memory hypothesis leads to the expectation that the No 



Marker conditions, particularly the In the Head-No Marker condition, 
will lead to a marked increase in number of repetitious choices and, 
perhaps, a slight increase in number of inefficient and redundant 



choices . 

Table 5.5 contains mean inefficient and redundant choices and. 
mean repetitious choices by experimental condition. The differences 
among conditions in inefficient and redundant choices were not signifi- 
cant. Table 5.6 contains the analysis of varianca for number of 
repetitious choices. Both factors and the interaction were significant. 
Comparisons (g « .05) using the Mec^man-Keuls procedure showed that 
there were more repetitious choices under the In the Head-No Marker 
condition than under any of the other three conditions and that there 
i^ere no differences among the latter conditions. 
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Table 5.5 



Meaa Inefficient and Redundant Choices and Mean 
Repetitious Choices per Problem by 
Experimental Condition 



Condition 


Inefficient 
and Redundant 
Choices 


Repetitious 

Choices 


On the Board-! tarkers 


2.33 


.11 


On the Bcard-No Markers 


1,94 


.39 


In the Head-Markers 


1.94 


.44 


In the Head-No Markers 


2.28 


•L 4* fit' 



Table 5.6 



Analysis of Variance of Repetitious Choices 



Source 


df 


MS 


F 


On the Board vs In the Head (P) 


1 


35.04 


16. S5 


Markers vs Ho Markers 


1 


30.38 


14.61** 


P X M 


1 


12.04 


5.79* 


within groups 


20 


2.08 





Total 



23 
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It may be reasonably argued that the present experiment did not 



provide a strong test of the hypothesis that children are unable to 



conceive combinatorial possibilities. It could be maintained that 
the fact that the pencils were progressively displayed under the In 
the Head-Marker made the eapaelty to conceive combinatorial possibilities 
relatively unimportant whereas both hypotheses predict poor performaince 
under the In the Head-No Nferkers condition. The telling couiiter- 
argument has to do with thQ nature of the poor performance under this 
condition. The data suggest that the poor performance under the In the 
Head-No Markers condition is attributable to memory failure rather 
than failure in logie, 

A more general reservation is that the children had considerable 
experience with all of the pencils during the orientation task such 
that during problem solving it was not necessary for them to ’*concelve‘ 
entirely new co. binsitions but merely to recall combinations— that is , 
pencils — which they had seen earlier. None of the data from the present 
experiment permit a rebuttal to this argument. 

In summary j the data strongly suggest that one function of 
instances in the form of concrete stimulus objects is to make a physical 
record of the problem solver *s responses and accompanying stimuli 
associated with these responses. The performance of eight- and nine- 
year-olds on concept attainment problems seems to be facilitated by 
the presence of concrete stimulus objects because the objects help the 
child remember what he has already done and what he has already learned. 
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The data do not support the Fiagetian hypothesis that instances in the 
form of concrete stimtilus objects facilitate the problem solving 
performance of children because they otherwise would not be able to 
conceive the instances logically needed to solve concept attainment 
problems; however, there remains the possibility that this theory would 
receive support under conditions r included in the present experiment* 



.‘jiderson 



129 



CHAPTER 6 



Part Versus l^Wiolr Task Procedures for Teaching 
a Problem-Solving ' Skill to Children^ 



Educators who have been influenced by the programed instruction 
movement take it as self-evident tnat the best way co teach a complex 
skill is to analyze it into component subskills and subconcepts , then 
teach each of these in turn. Cast in different language such an 
approach is a part-task metliod, to be contrasted with the whole-task 
method in which the student is required to perform the terminal behavior 
as best he can from he very beginning of training. Surprising as it 
may seem to those who have been influenced by the conceptions of programed 
instruction* the research on complex skill training has frequently 
shown whole methods to be superior to part methods. 

The terms ‘’parc®‘ and ‘'whole'* will be used in this chapter as 
shorthand words for talking about the issue of how lengthy and complicated 
a segment of a task the student should be required to attempt during 
instruction, especially during the initial stages of instruction. Fart 
methods result in low initial error rates and fast progress £, at least 
at the beginning of Instruetion, but when account is taken of the time 
to combine the parts* typically the advantage for the part method has 
been negligible at best. In the case of rote materials* practice on 
later parts (sublists) produces Interference with earlier parts. This 

version of this chapter will appear in the Journal of Educa- 
tional Psychology. 
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interf ssrencs must be overcome during the combination stage. With respect 
to complex skills and structured, meaningful matertel, there are coordina' 
tions and interrelationships among the subskills and subconcepts that 
cannot be acquired from training tflth the components alone. Herein 
lies one apparent reason that whole-task training has frequently proved 
superior to part training in the case of complex skills* 

Miether a procedure which emphasizes lengthy task segments will 
prove superior to a procedure that begins with short task segments will 
surely be heavily dependent upon the manner in which the training 
procedures are developed. If entering behavior is underestimated and 
the steps in the part procedure are more finely granulated and more 
numerous than necessary, it may be less efficient than a procedure in 
which larger task segments are emphasized. Further, particularly when 
the task analysis underlying the part procedure is incomplete, subjects 
who receive the "part” or small-step procedure may fall to learn 
coordinations among component skills and concepts, whereas subjects 
trained from the beginning on larger segments of the task may induce 
these coordinations. 

There may also be characteristics of tasks which systematically 
interact with the length and complexity of the instructional units 
into which the task is divided. May lor and Briggs (1963) have suggested 
that the relative effectiveness of part and whole methods is a function 
of the level of complexity and the degree of organization of the task. 
Task "complexity" is said to refer to demands on information-processing 
and memory-storage capacities" while task "organization" is said to 
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refer to the nature and extent of the interrelationships among task 
dimensions. As organisation increases, x^hole methods are predicted to 
be increasingly superior to part methods. For a highly organised task, 
an increase in complexity (difficulty) is predicted to result in 
greater superiority for the wl le method. The part method is predicted 
to be superior to the whole method only in the case in which the task 
is both complex and unorganiEcd. Hay lor and Briggs (1963) completed an 
experiment, using what may be called concept learning tasks, in which 
it was found that the whole method was much better than the progressive- 
part method on a highly organiEed task regardless of task complexity. 

On an unorganised task, the whole method was slightly better when task 
complexity was low and very slightly worse than the progressive-part 
method when task complexity was high. 

The experiment reported herein involved a comparison of a small- 
step, programed part-task method and a whole-task method for teaching 
children a complex problem solving skill, the skill of varying each 
factor ij^ succession while holding all other factors constant, iilhis 
skill is a classical strategy of experimental science and it is applicable 
to a large and important class of problems (Bruner, Goodnow, and 
Austin, 1956, pp. 81-125). The strategy was analyEed in detail in 
Chapter 1« 

Relative to the tasks employed by Naylor and Briggs (1963) the 
problem-solving task used in the present experiment would have to be 
regarded as highly organiEed. Furthermore, the task is very difficult 
(complex) for seven-year-olds (Anderson, 1965), the age of the subjects 
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(^s) in the present study. According to Inhelder and Piaget (1958, 
p. 335) people do not normally acquire the skill taught in the present 
experiment until 14-15 years of age. For these reasons, if Naylor and 
Briggs (1963) are correct, this should be a case in which the whole 
method is vastly better than the part method. 

Method 



Materials . Three sets of materials were employed. These materials 
were described in detail in Chapters 1 and 2. The description will be 
merely summarized here. The card array consisted of eight 2-1/2 X 
3-1/4 in, cards taped in an orderly arrangement on a 16 X 18 in. Masonite 
panel. The cards had figures inscribed upon them that varied with 
respect to number (one figure or two figures), color (red or green), 
and form (rectangle or diamond) . The cowboy game consisted of eight toy 
plastic cowboys and accessories imbedded in an orderly arrangement in 
a 12 X 13 in. plaster of paris base. The cowboys x^rere either standing 
or riding horses, either x^ith or without hats, and either x^ith or without 
rifles. The final set of materials consisted of eight yellow, hexonanal 
number two pencils. The pencils displayed three attributes: length 

(6 or 2 in.), presence or absence of eraser, and sharpened or unsharpened. 
The pencils were arrayed in a disorderly fashion on a table in front of 
the £. While these three sets of materials involved different stimulus 
dimensions and different “'story lines" were employed with them, an 
identical problem solving task could be created xjith each set of 



materials. 
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Part- task training . Three programs, one for each of the three 
sets of materials, were developed to teach children to apply the technique 
of varying each factor in succession while holding all others constant. 
These programs had their origins in a free wheeling, loosely-programed 
training procedure which, nonetiKeless , achieved considerable success 
with bright first graders (Anderson, 1965). A modification of this 
procedure, which more nearly resembled a program, was first developed 
for the card array. This 133-frame version was tried with 10 second 
graders from a lower middle class, urban school. Six of the 10 
reached an a priori criterion of correct performance on four out 
of the last five frames in the program. One chili stalled completely, 
falling to complete the program. Three other children completed the 
program but failed to reach the criterion. Among those who completed 
the program, the error rates ranged from 6.0% to 31.6% and the mean 
was 17.6%. The mean time to complete the program was 66 minutes. 

A substantial revision of the card array program was completed in 
which 49 frames were added, a number modified, and none eliminated. 

The revised program was tried with 10 second graders from a school in 
a rural community. On the last 10 frames of the program, upon which 
terminal behavior was required, seven children made no errors, one 
made one error, one made two errors, and one made three errors. The 
error rates over the entire program ranged from .5% to 18.7% and the 
mean was 8.7%. The mean time for completion was 73 minutes. A revision 
was made on the basis of these data. Eighteen frames were added to 
make a total of 200 and several other frames were modified. The card 
array program was not used again until the experiment described in 
this chapter. 
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The pencil program consisted of a literal translation of the card 
array program. In each frame , a pencil word or symbol was substittited 
for every card array word or symbol. No other modifications were mad©.; 
Prior to the experiment, the pencil program was run with 10 naive 
second graders from a school in a rural community. The error rates 
ranged from 1.5% to 11.0% with a mean of 6.9%. The mean time to complete 
the program was 104 minutes. On the last 10 frames, six children mads 
no errors, three made one error, and one made two errors. The cowboy 
program was also created by a literal translation of the card array 
program; however the cowboy program was not used with any children 
prior to the experiment. 

The final form of the programs embodied an analysis of the total 
problem-solving strategy into two major subskills. The first section 
of each program was designed to teach appropriate conclusion-drawing 
behavior. began by naming concepts while pointed to all of the 
positive instances of the concepts. Then the roles were reversed; 

E pointed to all of the positive instances of concepts and S named 
the concepts. Next, E pointed to sets of instances, some positive and 
some negative, in such a way that each set defined a concept; ^ named 
the concepts. For example, E might point to a long sharpened pencil 
with no eraser and a short sharpened pencil with no eraser, indicating 
that each of these “showed the secret,** then a long sharpened pencil 
with an eraser and a long unsharpened pencil without an eraser, 
indicating that the latter two did not **show the secret . If the child 
responded *'the secret is sharpened with no eraser, * he answered 
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correctly. Iv^en £ could correctly name seven out of eight consecutive 
concepts given a set of defining instances (a criterion he was required 
to meet before proceeding) , he was then judged to have acquired a 
satisfactory approximation of the conclusion— drawing skill. 

The second component in the total problem-solving skill is the 
skill of selecting appropriate Instances. To begin the section of the 
program teaching this skill, E pointed to an instance. S was required 
to pick an Instance which was different from E’s instance in a specified 
way but the same in every other way. For example, ^ might be instructed 
to "pick a pencil just the same as mine except that it is a different 
length." After several frames involving the stimulus dimensions of 
a task taken one at a time, ^ was then required to pick three instances, 
each of which differed in exactly one respect from the instance 
designated by E. When S reached a criterion of seven out of eight 
consecuti\^e correct selections ©f sets of three instmiceS; lie had 
mastered the skill of selecting instances. 

The final section of each version of the part— task program taught 
the child to integrate the conclusion-drawing skill with the instance- 
selection skill. In this section, the child selected a set of 
instances $ using the child’s instance, ^defined a concept; finally y, 
the child named the concept. Next, E began indicating whether each 
instance was positive or negative as soon as the child selecced it, 
instead of waiting until he had selected the entire set. This 
latter procedure was the same as with che terminal problems, except that 
when the child selected an Inappropriate instance he was corrected 
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before being told whether the instance was positive or negative. The 
child was not corrected on the 20 terminal frames, each of which 
entailed a problem presented using the same procedures as were used 
for test fiLoblems. 

A standard correction procedure, not expressly described within 
the program, was implemented by ^ v?henever ^ made an error. JE 
created a new problem similar to the one upon which the error was made, 
told ^ the answer to the new problem, and then presented the original 
problem a second time. This procedure almost always prompted the correct 

response. 

T^ole-task training . 1-Jhole-task programs were developed for 
the card array, the cowboy game, and the pencil collection. The 
three versions of the program were equivalent in the sense that a 
systematic substitution of words and sjmibols would permit the literal 
translation of one version into anotheiiTt The first section of the 
whole-task program was identical to the first section of the part- 
task program. In this section E named concepts and £ pointed to all 
of the positive instances of the concepts. Thereafter, ^ received 
terminal problems. E designated a focus instance. ^*s task was to 
choose instances until he could name the concept, l^henever ^ chose 
an instance B indicated whether the instance 'showed the secret . 

With one exception, the procedures for presenting problems within the 
whole-training program were the same as the procedures for administering 
test problems to be described in the next section. The exception 
that when S selected six Instances during a training problem 
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without solving the problem ^ told the child the correct concept. 

Feedback of this sort was not given during the last 20 training 
problems nor during test problems. 

The part-task and whole-task programs were equated In terms of 
the total number of task-relevant overt responses required under the 
assumption of error-free performance. This measure resembles measures 
such as number of trials that can be applied to simple tasks. For 
example, a child who behaves ideally on a terminal problem will select 
three instances and state a conclusion, a total of four distinguishable 
overt responses. Each of the versions of the part-task program 
required a total of 360 task-relevant, overt responses whereas each 
of the versions of the whole-task program required 364 such responses. 

The first 28 and the last 80 responses (20 terminal problems) were 
the same for both programs. In between, those who received the part-task 
program were led to make a progression of 252 responses designed to 
teach them a conclusion-drawing skill, an instance-selection skill, 
and to Integrate the two, as detailed earlier. The middle section of 
the whole-task program, on the other hand, contained 64 terminal problems 
which could have been solved with 256 overt responses. It should be 
emphasised that these calculations are based on the assumption of 
error-free performance. Of course, errors were made. Based on data 
collected during the experiment, the typical £ who received the part- 
task program tn estimated 410 overt, task— relevant responses while 

the typical S who received whole-task training made about 620 such 
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Procedure * The training and the test problems were presented 
by three female graduate assistants, each of xi^hom had had 15 or more 
hours experience training and testing children prior to the experiment. 
The author monitored one to two hours of each ^E*s preexperimental 
training and testing performance. Several staff conferences were held 
in which the letter and spirit of the procedures were detailed, 
ambiguities resolved, and difficult problems discussed. In addition, 
each E had a ten-page manual giving an overviex? of the experiment and 
summarizing training procedures, and a seven-page manual setting 
forth the procedures for administering test problems. 

Each child was trained and tested by a single One-third of 
the under each treatment in the experiment were run by each E, 
Training and testing sessions were scheduled to be 20 min, in length. 
Unless the child was sick or some other circumstances such as a 
special school program Intervened, the child received three sessions 
a week until he completed the training and the testing. Most sessions 
were conducted at three x^idely separated stations in a large general 
purpose room in the cooperating elementary school. 

For both part-task training and whole-task training there x^as 
a mimeographed copy of the program for each child. The child did not 
read the program. Rather, the program x<ras a script that guided the 
behavior of E> Except as otherwise Indicated, E adhered closely to 
the program, which described the stimulus S xms to see, contained the 
verbatum language E was to use, and indicated the response or responses 
S was to give. 
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Under both training methods E made generous use of social 
reinforcement. The frequency and contingencies of reinforcement were 
not expressly indicated within the programs, but instead were under 
the extemporaneous control of E. Particularly with respect to the 
whole-training procedure, which was quite aversive for some ^s (at 
the beginning of training, especially) ^ was coached to maintain a 
pleasant, non judgmental posture in the face of poor performance, and 
to find every opportunity to reinforce. Overall, E probably g^ve 
supplementary social reinforcement (in addition to feedback) for about 
every third correct response or chain of correct responses, except 
when ^ was doing poorly, in which case every correct response was 
reinforced. 

Presentation and scoring of test problems . The procedure was 
described in detail in Chapter 2 and will not be repeated here. 

An £ solved a problem when he selected a series of instances and 
stated a conclusion such that the instances implied the conclusion and 
no other. Performance on terminal problems was scored on a three point 
scale as follows: a) £ solves the problem and neither makes any 

logically inappropriate choices of instances nor states any incorrect 
conclusions (2 points); b) S solves the problem but makes one or 
more inappropriate choices or states one or more incorrect conclusions 
(1 point); c) B fails to solve the problem (0 points). The test protocols 
were punched on cards and then scored on an IBM 1620 computer using 
a program written for this purpose. The terminal problems Included 
within the training programs were scored on the same three point scale 
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as the test problems. However, problems presented during training 
were scored on the spot by ^ and only an abbreviated protocol was 
written. The measure reported is percent of possible score. For 
example if an ^ solved a problem but made one or more inappropriate 
choices of instances his score would be 50% on that problem. 

Design and subjects . There were three treatment conditions. One 
group (P) received part-task training. Another group (W) received whole- 
task training. A control group (C) received no treatment. Every ^ in 
the former two groups received training with two sets of materials. 
One-sixth of the ^s in each of the training groups was assigned to one of 
the six possible permutations of the three sets of training materials 
taken two at a time. About 48 hours after completing training, £s in 
the training groups received eight test problems to assess retention. The 
retention problems involved the second set of materials with which ^ 
received training. Each control £ received the retention problems during 
his first experimental session. One-third of the control ^s received 
problems involving each of the three .sets of materials. 

About. 4*8* hours « after receiving the retention problems ^s received 
a series -of eight* test problems to assess transfer of training. The 
transfer probl@D 2 S- entailed the set of materials which, S had not 
encountered during training. One-third of the control £s received transfer 
problems Involving each of the three sets, of materials, a different set 
than was encountered during the retention problems. 

With respect to both the retention and transfer problems, £ received 
two 0-dlmensional problems, two 1-dimensional problems, two 2-dlmensional 
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problems, and two 3-dlmensional problems. The order of presentation 
of problems was randomized for each ^ independently of other £s. 

The £s were 53 second-semester first graders from a predominantly 
middle-class school located in a new housing development on the outskirts 
of a Midwestern city of 30,000. These Ss were randomly selected from 
among all of the first graders in the school and randomly assigned to 
experimental conditions. Since the study was conducted over a three month 
period, the experimental conditions were scheduled in a predetermined 
random order. There were 18 Ss in Group W and in Group C but only 17 
in Group P. There was to have been an eighteenth £ in this group; however, 
the last £ to be run (who appeared to be making normal progress) had to 
be dropped because of the Impending end of the school year. He was 
replaced by a dummy case at the cell mean to balance the design for 
statistical purposes. 

Classroom teachers administered the California Test of Mental 
Maturity (Long Form, 1963 Revision). Unfortunately one teacher found it 
necessary to terminate the examination in the middle of a subtest 
because of Inattention and disorderly behavior, so it is not possible 
to report IQs or MAs. Raw score (not including Delayed Memory subtest 
score) means and standard deviations were 64.6 and 8.2 for Group P, 

69.3 and 7,4 for Group W, and 66,4 and 7,0 for Group C (£ «» 1.77, 



Anderson 



142 



Results 



Acquisition , Table 1 contains mean training times. Table 2 
contains mean percent of possible score on the last 12 training problems. 
Table 3 presents the analyses of variance for these mearures. As can 
be seen. Group P performed better on the problems whereas Group W 
completed training in a shorter period of time. Based on the estimates 
of number of responses made during training, which were described 
earlier, and the training times that appear in Table 1, it is estimated 
that during training Group P made relevant, overt responses at the rate 
of about 3.7 per min. The rate for Group is estimated to have been 
about 7,9 per min. 

The mean training times for Group P were considerably higher than 
the times obtained during preexperlmental development ©f the programs. 
Part of the discrepancy was no doubt due to the fact that second graders 
were used in most of the de\'elopmental work xi?hlle first graders were 
employed in the experiment. Also at two points in the versions of 
program used in the experiment ^ had to reach a criterion before pro- 
ceeding, These criteria were not part of the preexperiraental procedure. 

It might be argued that if Group W had been allowed as much 
training time as Group P it would have performed as well on the terminal 
problems. Fig. 1 pictures performance over blocks of 12 problems for 
Group W. notice that performance reaches an asymptote by the sixth or 
seventh block on the first task. Consequently^ it seems highly 
Improbable that further practice would have improved the performance 
of Group W very much. 
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Table 6.1 

Mean Training Time in Minutes 



Materials 


First Task 


Second Task 


Part 

Training 


T^hole 

Training 


Part 

Training 


Mhole 

Training 


Cards 


96.4 


76.3 


96.2 


53.0 


Cowboys 


144.9 


93.2 


81.7 


65.3 


Pencils 


135.9 


98.2 


107.7 


85.2 


All materials 


125.7 


89.2 


95.2 


67.8 


Note. — The 


SDs (estimated 


from MS error 


terms) were 


25.9 for 



the first task and 24,4 for the second task 
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Table 6.2 

Mean Percent of Possible Score on the 
Last Twelve Training Problems 



Materials 


First 


Task 


Second Task 


Part 

Training 


Whole 

Training 


Part 

Training 


t^hole 

Training 


Cards 


88.9% 


56.9% 


63.9% 


57.6% 


Cowboys 


49.3 


54.2 


85.4 


42.4 


Pencils 


84.0 


43.7 


81.2 


63.2 


All materials 


74.1 


51.6 


76.9 


54.4 


Note. — The 


SOs (estimated from IIS error 


terms) were 


17.3 for 



the first task and 18.0 for the second task 



Analysis of Variance for Acquisition Data 
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There were significant differences between materials on the first 
training task due in large part to the relatively poor performance with 
the cowboys. We have observed that the story line employed with the 
coxirboys tends to interfere with the problem-solving of some children, 
who insist that the “friends of the sheriff” must have rifles or must 
ride horses. Other investigators have made similar observations 
(Bruner, et al , 1956, p. 111). Evidently by the time he reached the 
second task S had learned enough so that he was not distracted by the 

story line. 

There were significant materials effects on training time due to 
the pencils. The pencils x^ere handled by S and shuffled by E after each 

problem. These manipulations took time. 

Retention and transfer . Table 4 presents the analyses of variance 
for the retention and transfer problems while Table 5 contains the means 
for the two kinds of problems. In both cases there were Insignificant 
differences among treatments. Comparisons (a * .01) using the Newman- 
Keuls procedure indicated that on retention problems Group P was superior 
to both the other groups and Group W was superior to Group C. On the 
transfer problems Groups P and W were not significantly different but 
both were superior to Group C. 

There were significant differences in the difficulty of the transfer 
problems according to the number of relevant stimulus dimensions the 
problems entailed. The means were 44.9%, 49.1%, 42.6% and 32.9% for the 
0-, 1-, 2-, and 3-dimensional problems, respectively. There x^as also 
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Table 6.4 



Analysis of Variance for Retention and Transfer Data 







Retention Problems 


Transfer Problems 


Source 


df 


HS 


F 


MS 


F 


Between 












Treatment (T) 


2 


103.39 


60.55 


26.54 


•kit 

11.80 


Materials (M) 


2 


1.01 


.59^, 


2.06 


.91 


T X M 


4 


5.42 


3.18 


3.10 


1.38 


Ss w. grt*:' 2 j#s 


45 


1.71 




2.25 




Within $s 












Dimensions (D) 


3 


1.07 


2.40 


4.08 


kk 

6.00 


T X D 


6 


.64 


1.44 


. 81 




M X D 


6 


.30 


. 68 


2.12 


3.12 


T X M X D 


12 


.62 


1.39 


.62 


.92 


Ss w. groups X D 


135 


.45 




.68 
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Table 6.5 

Mean Percent of Possible Score on Retention and Transfer Problems 





Part Training 


Whole Training 


No Training 


Retention problems 
Cards 


62.5% 


57.3% 


10,4% 


Cowboys 


86.5 


35.4 


18.8 


Pencils 


76.1 


55.2 


16.7 


All materials 


75.0 


49.3 


15.3 


Transfer problems 


Cards 


44.8 


58.3 


30.2 


Cowboys 


49.0 


41.7 


21.9 


Pencils 


65.6 


46.9 


22.9 


All materials 


53.1 


49.0 


25,0 



Note.— The SDs (estimated from MS error terms) were 16.3 for 
the retention problems and 18.8 for the transfer problems when 
scores were pooled across dimensions. 
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a significant Materials X Dimensions interaction for the transfer problems, 
due primarily, for reasons which are not clear to the author, to the 
relatively great difficulty of the 0-dimensional card problems. 

Discussion 



The results indicate some limits to the generality of the rule 
proposed by Naylor and Briggs that whole training will be superior to 
part training for ’’highly organized" tasks. Of course it may be that 
there are characteristics of tasks, such as the amount and nature of its 
organization, which systematically interact with the length and complexity 
of the responses required from the subject at various stages during 
training, but this is evidently a matter about which there is much to 
be learned. The present author is pessimistic about the liklihood 
that broad generalizations concerning method-task interactions will 
emerge in the near future. Too much depends upon the specific features 
of the methods and the details of implementation of these features. 

Both Informal observation and the objective data suggest that in 
the present study ^s who received whole training did not acquire a 
systematic instance-selection skill, or, at least, that they did not 
acquire the same skill as was acquired by most ^s who received part 
training. The x^hole group made a mean of 1.88 logically inappropriate 
choices of instances per retention problem, whereas the mean was 1.08 
for the part group * 3.19, df * 33, £ < .01). Furthermore, there is 
reason to believe that there were qualitative differences in the 
conclusion-drawing behavior of the two groups. Most S.s in the part group 
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learned to draw conclusions based on a restricted set of instances 
containing only the minimal information logically necessary to solve 
the problem. Sb in the whole group seldom gave conclusions until they 
had selected a larger-than-logically-necessary set of instances. The 
typical R in Group W rapidly and, seemingly, haphazardly selected 
Instances until a conclusion occurred to him. Most ^s in Group P, on 
tlie other hand, selected instances slowly and their behavior usually 
conformed to the method of varying each factor in succession while 
holding all other factors constant. At the point at which just enough 
information uas available logically to solve the problem, the typical ^ 
who received part training usually offered a conclusion. The marked 
differences between Groups P and TJ in rate of response during training 
can be traced to the contrasting patterns of behavior typical of S^s in 
the two groups. 

It seemed possible that children who received part training would 
be able to solve a high percent of the problems created with a new set 
of materials. Obviously this did not happen, indicating the need for a 
more refined method of producing generalized stimulus control (Anderson, 
1965). 

Group P did not do as t^rell as would be expected on the basis of the 
preexperimental data, probably because of the fact that first graders 
participated in the experiment whereas second graders were employed 
during program development. Actually the part procedure was successful 
with the majority of the first graders. Of the 17 ^s who completed 
part training, 11 scored 80% or better on the retention problems and 
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only three scored below 50%, The latter three fell at the bottom of 
the distribution of aptitude test scores. 

Unnecessarily small and redundant steps and failure to provide for 
integration of subskills and concepts may be shortcomings of any 
particular lesson employing a small-step procedure. The guidelines for 
lesson development which have emerged from the programed instruction 
movement have not been demonstrated to guard against these shortcomings^ 
indeed, it is possible that such deficiencies, particularly unnecessary 
redundancy, are endemic in currently available small-step, programed 
lessons. In the present Instance, a small— step procedure worked 
relatively well, l^hether a small-step, programed procedure would con- 
sistently prove best in other instances remains to be seen* 
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CHAPTER 7 
Sununary 

A classical strategy of experimental science is to vary, manipulate, 
or study each of the potentially relevant variables in succession 
while holding all other variables constant. This strategy, in simple 
or complex form, is the optimum method for solving a large and socially 
Important class of problems, including problems in scientific inquiry, 
medical diagnosis, and the trouble shooting of equipment malfunctions. 
One easy-to-study representative of this class of problems is the 
concept attainment problem. The subject (S) is shotm a positive 
instance (i.e. an example) of a concept called the “focus instance.** 

He then chooses instances. At each choice he is informed as to whether 
the Instance is positive or negative. As soon as he is sure he knows, 
the ^ names the concept. This report contains a theoretical and 
experimental analysis of children *s behavior on concept attainment 
problems. 

A standardized procedure was developed for administering concept 
attainment problems to children in the six to ten year age range. In 
all cases an experimenter (jS) worked with a single ^ at a time in 
sessions that were usually about 20 min. in length. The ^ read 
directions, indicated the focus instance, gave feedback as to whether 
the Instances the ^ chose were positive or negative, gave one or 
another of a series of standardized prompts necessary to keep 
performing, and decided when the problem should be terminated. The jS 
wrote a protocol indicating In coded form the Instances selected. 
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the conclusions S stated, and the behavior of E in the sequence in 
which these events occurred. The protocols were content analyzed using 
a computer program prepared for this purpose. Three basic measures 
of problem solving performance were employed. The first was number of 
problem solutions. An £ solved a problem if he selected a series of 
instances and stated a conclusion such that the instances logically 
implied the conclusion and no other , The second measure was number of 
logically inappropriate choices of instances while the third was number 
of logically inappropriate conclusions. A summary measure represented 
problem solving performance with a single score* a) the £ solved the 
problem and neither made Inappropriate choices nor stated inappropriate 
conclusions, b) the £ solved the problem but made one or more 
inappropriate choices or conclusions, c) the £ failed to solve the 
problem. 

The first experiment investigated both task factors and aptitude 
factors. A sample of 144 fourth graders completed nine concept attainment 
problems and also a battery of 24 aptitude tests. The task factors 
Investigated were order of presentation, type of materials, and number 
of stimulus dimensions defining the concept to be attained. Also 
investigated were the difficulty of specific concepts, given the 
materials, and number of relevant stimulus dimensions. Experimenter 
and school were replication factors. The chief results and conclusions 
of this study were as follows. 

1. Given a specified set of materials and a specified number of 
relevant stimulus dimensions, the particular concept to be attained 
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evidently has little effect on children* s problem solving behavior. 

There were only three significant (a * .05) effects in 27 one-way 
analyses of variance. Each analysis involved six groups, each of which 
received a different concept. There was no apparent pattern to the 
three significant effects that were obtained. 

2. Order of presentation of problem sets had a strong effect on 
all four dependent variables. Problem solving performance improved 
from the first to the third set of three problems. 

3. One-dimensional problems were easier to solve than either 2- 
or 3-dimensional problems. 

4. Type of materials affected only number of logically inappropriate 
choices of instances per problem. There were more such choices during 
cowboy problems than during card or pencil problems, perhaps because 

the "story line'® employed with the cowboys led to interfering associa- 
tions. 

5. There were more inappropriate conclusions, indeed, more verbal 
behavior both appropriate and inappropriate, during 3-dimensional 
problems than during 1- and 2-diraensional problems. This was inter- 
preted to mean that positive instances play a role in controlling 
conclusion-drawing and conclusion-stating behavior. Since none of the 
instances, except the focus instance, which the child encounterd during 
a 3-dlmenslonal problem was positive, verbal behavior was therefore 
Inhibited. 

6. Seven of the ten expected factors materialized in the components 
analysis of the intercor relations among the aptitude tests. The rotated 
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factors were named as follows: 1. Verbal Comprehension, II. Speed, 

III. Reasoning, IV. Ideational Fluency, V. Spatial Orientation, VI » 
figural Adaptive Flexibility, VII. Originality. 

7. Two aptitude factors— Spatial Orientation and Figural Adaptive 
Flexibility— showed modest correlations with problem solving performance. 
Evidently skill in dealing with spatial configurations plays a role in 
performance on concept attainaent problems. 

A second experiment investigated the effects of concrete stimulus 
objects on children's problem solving behavior. A Piaget Ian hypothesis 
is that concrete stimulus objects are Important for the problem solving 
performance of children in the seven to eleven year age range acause 
children of this age are unable to ‘‘conceive combinatorial possibilities." 
Consequently, if instances in the form of concrete stimulus objects 
are not available the child will be unable to select or construct 
instances logically appropriate to solve concept attainment problems. 

An alternative hypothesis, based on the analysis and data of this 
project, is that concrete stimulus objects are chiefly important as a 
memory aid; the objects help the child to remember what he has already 
learned. A sample of 24 third and fourth graders worked three pencil 
problems either "on the board, ‘‘ In x^hich the pencils were arrayed 
in front of the child, or "in the head," in which the pencils were 
concealed from the child's view. Under each condition, half of the 
received Markers. That is, each pencil named by was selected by jE 
and placed in view. The remainder received the No Markers condition. 
Consistent with the memory hypothesis, but not the Piagetlan hypothesis. 
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the In the Head-No Markers group shelved significantly more inappropriate 
choices and significantly fewer solutions than the In the Head-Markers 
group, whereas the In the Head-Markers group was not different from the 
two On the Board groups. A further, fine-grained analysis suggested 
that the poor performance of the In the Head-No Markers group was 
attributable to memory failure rather than logical failure. An incidental 
result was that there were fewer inappropriate conclusions during 3- 
dimensional problems than during 1- and 2-dimensional problems, 
confirming the result obtained in the preceding experiment. 

A third experiment compared methods of teaching children to solve 
concept attainment problems* Because of the programed instruction 
movement, it is widely believed that the optimum way to teach a complex 
skill is to analyze it into component skills and concepts md then 
teach each of these in turn. Put in other terms this is a *'part-task*' 
method to be contrasted with a ' ’whole- task^‘ procedure in r>hicfe the 
learner attempts the total skill early in training. The literature 
suggests that the whole-task procedures are better than part-task 
procedures particularly when a highly organized skill is being taught. 
Nonetheless, there is reason to believe that a programed part-task 
procedure might lead to better performance than an appropriate whole- 
task procedure even with respect to highly organized skills, provided 
that the part method is based on an adequate analysis of the task that 
takes account of the relationships among component skills. A part-task 
program was developed in a lengthy process of tryout and revision. 

The whole-task program included the same introductory and terminal 
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frames as the part-task program but the middle portion contained 84 
terminal problems* These problems could be solved with 256 task— relevant 
responses whereas those who received the part-task program were led 
to make a progression of 252 overt responses designed to teach them a 
conclusion-drawing skill, an instance-selection skill, and the integration 
of the two into a total skill. Groups of 18 first graders received 
either part-task or whole-task training with two sets of materials. 

Later these two groups, and a third group which received no training, 
got problems involving materials included during training to assess 
retention and problems from materials not included during training to 
assess transfer. On retention problems the part-task group did 
significantly better than the whole-task group which was in turn 
significantly better than the no-training group. The mean score on the 
summary measure of problem solving was 75% for the part-task group, 
indicating that the average child who received this form of training 
could solve three out of four problems presented to him without making a 
single logically inappropriate choice of instances or a single logically 
inappropriate conclusion. Those X'irho received whole-task training showed 
improvement but there was a rather low ceiling under this method. On 
the fourth block of 12 training problems whole-task ^s averaged 49% 
of the possible score while they averaged only 54% on the 14th block. 

Both the part-task and whole-task group performed significantly better 
on the transfer problems than did the no-training group; however, there 
was no difference between the former two groups. The results of this 
experiment confirm Anderson’s (1964, 1965) earlier finding that. 
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contrary to prominent developmental theories, first graders can develop 
a high level of skill at solving complex problems said to involve 
hypothetico-deductive reasoning. The experiment further showed some 
limits to the generalization that whole-task methods will be superior 
to part-task methods for highly organized skills. 
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APPENDIX I 



CONTENT 



ANALYSIS 

CAROS 



P R 0 G R A H 



C 

9500 

9501 

9502 

9503 

9504 

9505 
4002 
C 



6000 

6001 

1 

5060 

9549 

9550 

9560 

9561 

9562 

9563 
9996 



9555 

C 

9551 



4003 



DIMENSION ITASK(2), J(61), ITRILU6), ITRIL2(6), ITRI13(6), 

1 irRIL4(6K ITRIL5(6), ITRIL6{6), ICCEP<8). 

2 IIELD1(5), IFEL02(5). IFELD3(5), 'FELD4(5), 

3 IFELD5(5). IFELD6(5), IFELD7(5), A{6), AA{6), JJ(11) 

THE FIRST CARO MUST SAY PRINT OR PUNCH, STARTING IN COLUMN ONE 
READ 9500, I 

F0RMAT(1X,A1} 

I F( I -5900)9501 , 9503 , 9504 
PRINT 9*^02 

F0RMAT(62HTHE FIRST CARD MUST SAY PRINT OR PUNCH, STARTING IN COLU 
1MN ONE) 

GO TO 9999 

IPRINT=1 

GO TO 9505 

IPRINT=2 

ISKIPsI 

IFIELOsO 

MAIN LOOP 
DO 4100 L00P=1,100 ^ 

FIELDS —USE (IFEL0N(IFIEL0),IFIEL0=1,5) 

ALOOP=LOOP 

FL00P=L00P/5 

IF((ALOOP/5.0)-FLOOP)3519,6005,6000 

IFIELD°>UIFIELD 

GO TO (6001,6002,6003,6004), I FIELD 
READ 1, A, J . . 

FORMAT( IX , A3 ,A1 ,A3 , A4, A3 , A3 , IX ,61 A1 ) 

IF(J(13)-7100)5058, 9549, 5060 
GO TO (9554,6001), I SKIP 
IF(L00P-1 )9551 ,9551 ,9550 
GO TO (9560,9562), I PRINT 
IF( I TRIAL -6)9561 ,9551 ,9551 
PRINT 1002 
GO TO 9551 

IF( ITRIAL -6)9563, 9996, 9996 
IITERM=!ITERM4-1 
lUNNECs^l INEFF+IREOUN+IREPET 
IINAPP=IC0NBI+I1NC0N+IVM+IVPR 
IEXBEH=IP1+IP2+IP3+IM1+IM2+IM3+IE1+IE2+ITO 

PIIMPH AA. ( J J( I ) • I »5) » ® ® *7# • 1 } f * EFF » I# , 

1 I INEFF’ IREOUN IREPET.ICONDI,! INC0N,IVM,IVPR,IP1,IP2,IP3,IM1, 

1 I INEFF, I ITERM,|S0LVE,IUNNEC, I INAPP, 

^ IEX6EH 

F0RMAT(1H8,A3,A1,A3,A4,A3,A3,1Xi5A1,lX,5Al,1X,22l1,l2) 

THE FOLLOWING VARIABLES STORE TRIAL DIFFERENCES 
DO 4003 l<°1,6 
ICCEP(l)=0 
I TRIL4 (l)=0 
ITRIL6(I )sO 
ICCEP(7)=0 
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9552 
9564 

9553 

9554 
9997 
9990 



6002 



6003 



ICCEP(8)=0 
ICHANG=1 
IC0t'!C1-0 
IC0NC2»0 
IC0NC3°°0 
I C0NC4t=0 
ITR1AL=0 
I VERB4sO 
IEFFIC=0 
IINEFF=0 
IRE0Ui4=:0 
1REPET=0 
IC0NBI«0 
I INC0N=0 
J VM=0 
I VPR=0 
IP1=0 
IP2=0 
IP3=0 
IM1=0 
IM2=0 
IM3=0 
lElsO 
IE2=0 
IPV4=0 
IRCi^O 
1 1 TERM=0 
I S0LVE=0 
ILEFT2=8 

GO TO (9552,9554), I PR I la 
PRINT 9564 
FORMAT(///) 

PRINT 9553.A(3),A(6),(J(I), 1=1, 5), (J(l), 1=7,11) 

F0RMAT(5X,10HID NUMBER ,A3,5X,A3,5H TASK,5X,1 1HC0NCEPT IS ,5A1 ,5X 
19HF0CUS IS ,5A1) 

IS!<IP=1 

DO 9997 1=1,6 
AA( I )=A( I ) 

DO 9990 1=1,1 1 
JJ(i )=J(I ) 

IFELDI(l) = J(17) 

IFELD2(1) = J(18) 

IFELD3(1) = J(19) 

IFELB4(1) = J(20) 

IFELDS(l) = J(21) 

IFEI.D6(1) = J(22) 

IFELD7(1) = J(23) 

GO TO 6006 
IFELDK2) = J(26) 

IFELD2(2) = J(27) 

IFELD3(2) = J(28) 

IFELD4(2) = J(29) 

IFELD5(2) = J(30) 

IFELD6(2) = J(31) 

IFELD7(2) = J(32) 

GO TO 6006 
IFELDK3) = J(35) 

IFELD2(3) = J(36) 



6004 



6005 



C 

C 

C 

C 

6006 

9099 



3002 

13 

3003 

14 

3004 

15 

3005 
10 

3000 
1 1 

3001 

C 

C 

20 

201 

202 

21 



IFELD3(3) = J(37) 
IFEL04(3) = J(38) 
IFELD5(3) ■= J(39) 
IFELD6(3) = J(40) 
IFELD7(3) = J(41) 
GO TO 6006 
IFELDK4) = J(44) 
IFELD2(4) = J(45) 
IFEL03(4) = J(46) 
IFELD4(4) = J(47) 
IFELD5(4) = J(48) 
IFEL06(4) = J(49) 
IFEL07(4) = J(50) 
GO TO 6006 
IFIELD =5 
IFELDK5) = J(53) 
IFELD2(5) = J(54) 
IFEL03(5) = J(55) 
IFELD4(5) => J(56) 
IFEL05(5) = J(57) 
IFEL06(5) = J(58) 
IFELD7(5) = J(59) 
ICHAN&°2 
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DECODE THE FIRST CaUMN OF THE CONCEPT FOR THE CARD TASK 
(COLUMN 20) 

AND LET US CHECK TO SEE IF THE TRIAL SIGN WAS CORRECT WITH 

RESPECT TO THE CONCEPT 

IF(J(1 >-4200)9099, 3002, 13 

IC0NC4=1 

IWAS1=2 



IWAS2:°2 
IWAS3-2 
GO TO 40 
IC0NC3»1 
GO TO 33 

I F( J( 1 >-4400)3501 ,3003 ,14 
I CONC3=2 
GO TO 33 

IF( J( 1 >-4700)3501 ,3004,15 

IC0NC2=1 

GO TO 20 

IF(J(1 >-5900)3501 ,3005, 10 

ICONC2=2 

GO TO 20 

IF(J( 1 >-7100)3501 ,3000, 1 1 

IC0NC1=1 

GO TO 20 

IF(J(1 >-7200)3501,3001 ,3501 
IC0NC1=2 

decode^ THE SECOND COLUMN OF THE CONCEPT FOR THE CARD TASK 

IF(J(2)-4700)21,201,202 

IC0NC2a1 

GO TO 30 

IC0NC2»2 

GO TO 30 

IF(J(2)-4200)33,22,23 



22 

23 

C 

C 

30 

3t 

32 

C 

C 

C 

33 

34 

35 
C 

36 

37 

38 
C 

39 

391 

392 
C 

40 

401 

402 

41 

411 

412 

42 

421 

422 
C 

100 

1000 

1494 

1495 
1002 

1496 

1497 

1498 



IC0NC3®1 
GO TO 33 
I C0MC3=2 
GO TO 33 

DECODE THE THIRD COLUMN OF THE CONCEPT FOR THE CARO TASK 
(COLUMN 22) 

I F(J (3 >-4200)33,31 ,32 
I C0NC3=1 
GO TO 33 
I C0NC3=2 
GO TO 33 

NOW THE CONCEPT (1-3 DIMENSIONS) IS CODED IN ONES AND 
NOW CHECK TO SEE WHICH DIMENSIONS WERE USED 

WAS THE FIRST DIMENSION USED 
IF(ICONC1)3502, 35,34 
IWAS1=1 
GO TO 36 
I WAS 1=2 

WAS THE SECOND DIMENSION USED 
IF(ICONC2)3502, 38,37 
IWAS2=1 
GO TO 39 
IWAS?=2 

WAS THE THIRD DIMENSION USED 
IF(ICONC3)3502, 392,32= 

IWAS3=1 
GO TO 40 
IWAS3=2 

DECODE THE FOCUS FOR THE C 
IF(J(7)-7100)3503,401 ,402 
IF0CS1=1 
GO TO 41 
I FOGS 1-2 

IF(J(8)-4700)3503, 41 1,412 
IF0CS2=1 
GO TO 42 
I F0CS’=2 

IF(J(9)-4200)3503,421,422 

IF0CS3=1 
60 TO 100 
I F0CS3=2 
CO ***0 1 00 

LOOK FOR A TRIAL NUMBER, BUT FIRST LOOK FOR A FLANK 
IF(IFELD1(IF1EL0))4102,1000,1499 

I SKI P=2 

GO TO (1494, 1496), I PRINT 
I F( 1 TRI AL-6) 1 495 . 4001 , 4001 

F0RMAT(44HEXPERIMENTEP. TERMINATED THE PROBLEM TOO SOON) 

GO TO 4001 . „ 

I F( I TRI AL-6) 1 497 ,1493 , 1 498 

I ITERM=I ITERM+I 

IUNNEC=I INEFF+IREOUN+IREPET 

1 1 NAPP= I CONB I + 1 I NCON+ 1 VM+ 1 VPR 

IEXBEH=IP1+IP2+IP3+IM1:BM2+IM3+IE1+IE2+I^ 



TASK (COLUMNS 26-28) 
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C 

1499 

1500 

1501 

1502 

1503 

1504 

C 

101 

101 1 

1012 

102 

1021 



1C22 

103 

1031 

1032 

104 

1041 

1042 
C 

3007 

3008 

3009 

3010 

6007 

301 1 

3012 

6008 

3013 

3014 

C 

3015 

C 

3016 
3017 



C 

C 

C 

C 

C 

C 

C 

C 

C 



2 IM2,IM3,IE1,IE2,IPW,tRC,l 1 TERM, I SOLVE, I UNNEC, I INAPP, 

3 lEXBEH 
GO TO 4001 

DECODE A FIELD FOR THE CARD TASK 
IF(IFELD1(IFIELD)-7100)106,101,1500 
IF(IFELD1(IFIELD)-7200)41 02,101,1501 
IF(IFELD1(IFIELD)-7300)4102,101,1502 
IF(IFELD1(IFIEL0)-7400)41 02,101,1503 
IF(IFELD1(IFIELD)-7500)4102,101,1504 
IF(IFELD1(IFIELD)-7600)4102,101,4102 
TRANSFER TO 101 INDICATES THIS WAS A TRIAL 
ITRIAL=ITRIAL+1 

IF(IFELD2(IFIELD)-7100)3504,101 1,1012 
ITRILi (ITRIAL)=1 
GO TO 102 
ITRILI (ITRIAL)=2 

I F( I FELDS ( I F I ELD)-4700)3504, 1021,1022 
ITRIL2 (ITRIAL)=1 
GO TO 103 
ITRIL2 (ITRIAL)=2 

I F{ I FELD4{ I F I ELD)-4200)3504, 1 03 1 , 1 032 
ITRIL3 (ITRIAL)=1 
GO TO 104 
ITRIL3 (ITRIAL)=2 

I F( I FELDS ( I F I ELD)-1 000)3504, 1 041 , 1 042 
ITRIL4 (ITRIAL)=1 
GO TO 3007 
ITRIL4 (ITRIAL)=2 

NOW SET AN INDICATOR - ONE FOR PLUS, TWO FOR MINUS. 

ICHECK=1 

GO TO ( 3009 , 6007 ), IWAS1 
IFdCONCl-ITRILl (ITRIAL))3010,6007,3010 
I CHECK=2 

GO TO ( 301 1,6008), I WAS2 
IF(ICONC2-ITRIL2(ITRIAL))3012,6008,3012 
I CHECI<=2 

GO TO { 3013 , 3015 ), IWAS3 
IF(IC0NC3-ITRIL3(ITRIAL))3014,3015,3014 
I CHECK=2 

NOW CHECK THE SIGN 

IF (ICHECK - ITRIL4 (ITRIAL)) 3016, 1050, 3016 
IF CONTROL REACHES 3016 THEN THE TRIAL WAS MISCODED. 

PRINT 3017 , ITRIAL 

FORMAT (6HTRIAL ,I1,51H WAS MISCODED BY THE EXPERIMENTER OR THE K 
1EYPUNCHER) 

PRINT 1,A,J 
ISKIP::=2 
GO TO 4001 

TRIAL EVALUATION 
THE CONCEPT TABLE IS AS FOLLOWS 

ICCEP(I) CONTAINS NONE OF THE ATTRIBUTES (I.E. ALL ELEMENTS) 

ICCEP(2) CONTAINS ONLY THE FIRST ATTRIBUTE 

ICCEP(3) CONTAINS ONLY THE SECOND ATTRIBUTE 

ICCEP(4) CONTAINS ONLY THE THIRD ATTRIBUTE 

ICCEP(5) CONTAINS THE FIRST AND SECOND ATTRIBUTES 

ICCEP(6) CONTAINS THE FIRST AND THIRD ATTRIBUTES 

ICCEP(7) CONTAINS THE SECOND AND THIRD ATTRIBUTES 



c 

c 

1050 

c 

4005 

4006 
C 

C 

C 

1120 
1 121 

1 122 

1 123 

1124 

1125 
6036 

1126 

1127 

C 

C 

C 

1 128 
C 

C 

C 

C 

1 100 

4270 

4271 

4272 

4273 

4274 

C 

4275 
4277 



4278 



4279 



4280 

4276 

1101 



IN GOING FROM THE FOCUS 



ICCEP(8) CONTAINS ALL THREE ATTRIBUTES 168 

HOW MANY CONCEPTS ARE ON THE TABLE 

ILEFT1=0 

ICCEP(l)=0 FOR ON THE TABLE, AND ICCEP(I)=2 FOR OFF THE TABLE 

IF (ICCEP(D) 3513 , 4005 , 4006 

JLEFT1=ILEFT1+1 

CONTI NUE 

NOW ILEFT1 CONTAINS THE NUMBER OF CONCEPTS REMAINING ON THE TABLE 
WHICH ATTRIBUTES WERE CHANGED IN GOING FROM THE FOCUS 

TO THE TRIAL , ^ 

IF(IF0CS1-ITRIL1(ITRIAL))1 122,1121,1122 

IATBT1=1 

GO TO 1123 

IATBT1=2 

IF (IF0CS2 - ITRIL2 (ITRIAL)) 1125, 1124, 1125 

IATBT2=1 

GO TO 6036 

IATBT2=2 ^ 

IF (IF0CS3 - ITRIL3 (ITRIAL)) 1127, 1126, 1.27 
IATBT3=1 
GO TO 1128 
IATBT3=2 

NOW WE KNOW WHICH ATTRIBUTES WERE CHANGED 
TO THE TRIAL 

LOOK TO SEE IF THE TRIAL WAS POSITIVE OR NEGATIVE 
IF(ITRIL4(ITRIAL)-1)3517, 1129 , 1100 „..r 

TRANSFER TO 1100 INDICATES THE TRIAL WAS NEGATIVE. 

WE MUST NOW DELETE ALL CONCEPTS IN THE TABLE THAT DO NOT CONTAIN 
AT LEAST ONE (OR SOME OR ALL) OF THE ATTRIBUTES CHANGED 
DEVELOP BRANCHING FOR TWO AND THREE VALUE CHANGES 
JDFRNC=0 

GO TO (4271,4270),IATBT1 

JDFRNC=JDFRNC+1 

GO TO (4273,4272), I ATBT2 

JDFRNC=JDFRNC+2 

GO TO (4275,4274), I ATBT3 

JDFRNC>.JDFRNC-t-4 

GO^ TM 4276 ,4276,4277, 4276 , 4278 , 4279 , 4280) , JOFRNC 

ICCEP(1)=2 

ICCEP(4)=2 

GO TO 1135 

ICCEP(1)=2 

ICCEP(3)=2 

GO TO 1135 

ICCEP(1)=2 

ICCEP(2)=2 

GO TO 1135 

ICCEP(1)=2 

GO TO 1135 

GO TO (1102, 1101), IATBT1 

ICCEP(1)=2 

ICCEP(3)=2 

ICCEP(4)=2 

ICCEP(7)=2 

GO TO (1104, 1103 ), IATBT2 



1102 



1103 



1 i04 
1105 



C 

C 

C 

1129 

1 130 



1 1 31 

1132 



1133 

1134 



C 

1135 



4007 

4008 
C 

C 

C 

C 

C 

C 

4009 

4010 

4011 
C 

4012 

9507 

4013 

9508 

C 

C 

4014 
C 

C 

4015 



1CCEP(1)=2 

ICCEP(2)=2 

ICCEP(4)=2 

ICCEP(6)=2 

GO TO (1135, 1105), 1ATBT3 

ICCEP(1)=2 

ICCEP(2)=2 

ICCEP(3)=2 

ICCEP(5)=2 

GO TO 1 i35 

TRANSFER TO 1129 INDICATES THE TRIAL WAS POSITIVE. 

WE MUST NOW DELETE ALL CONCEPTS IN THE TABLE THAT CONTAIN THE 
ATTRIBUTE(S) CHANGED. 

GO TO { 1131 , 1130 ), lATBTl 

ICCEP(2)=2 

ICCEP(5)=2 

ICCEP(6)=2 

ICCEP(8)=2 

GO TO (1133, 1132 ), IATBT2 

ICCEP(3)=2 

ICCEP(5)=2 

ICCEP(7)=2 

ICCEP(8)=2 

GO TO (1135, 1134), IATBT3 

ICCEP(4)=2 

ICCEP(6)=2 

ICCEP(7)=2 

ICCEP(8)=2 

HOW MANY CONCEPTS REMAIN ON THE TABLE 
1LEFT2 = 0 
DO 4008 1-1,8 

IF (ICCEP(I)) 3513 , 4007, 4008 

ILEFT2=ILEFT2+1 

CONTINUE 

NOW ILEFT2 CONTAINS THE NUMBER OF CONCEPTS REMAINING ON THE TABLE 
AFTER THE LATEST DELETION 

NOW WERE ANY CONCEPTS ELIMINATED BY THE TRIAL 

IF (ILEFT1-ILEFT2) 4043, 4009, 4022 

IF CONTROL REACHES 4009 NO CONCEPTS WERE ELIMINATED 

NOW WAS IT REDUNDANT OR REPETITIOUS (WAS THERE A DUPLICATION) 

IT WILL HAVE DUPLICATED THE FOCUS IF lATBT 1,2, AND 3 ARE 1 
IF (lATBTl-1) 4044, 4010, 4014 

IF (IATBT2-1) 4044, 4011, 4014 

IF (IATBT3-1) 4044, 4012, 4014 

(THEY ARE ALL ONE IF WE REACH 4012) 

GO TO (9507,9508), I PRINT 
PRINT 4013 , 1 trial 

FORMAT (6HTRIAL ,11, 16H WAS REPETITIOUS) 

IREPET=IREPET+1 
GO TO 4000 

(IT DIO NOT DUPLICATE THE FOCUS, SO CHECK IT AGAINST THE 
PRECEDING TRIALS) 

DO 4018 N1, I TRIAL 

ARE WE COMPARING THE TRIAL TO ITSELF 

IF (l»ITRIAL) 4015 , 4018, 4015 

NO 

IF(ITRIL1(I)-ITRIL1(ITR1AL))4018, 4016, 4018 



4016 

4017 
C 

C 

4018 

9509 

4019 

9510 

C 

4020 

9511 

4021 

9512 

C 

C 

4022 

4023 

4024 

4025 

4026 
40/7 
C 

4028 
C 

4029 

9513 

4030 

9514 

C 

C 

4031 

4053 

C 

4032 

4033 

4034 

4035 

4036 

4037 
C 




4039 

9515 

4040 

9516 

4041 
C 

C 

C 



IF (ITRIL2{I) - ITRIL2{ITRIAD) 4018 , 4017 , 4018 

IF(ITRIL3(I)-ITRIL3(ITRIAL))4018,4020,4018 

IF CONTROL REACHES 4018 THEN A DUPLICATION DID NOT OCCUR 

THEREFORE THE TRIAL WAS REDUNDANT 

CONTINUE 

GO TO (9509,9510), IPRINT 
PRINT 4019,ITRIAL 

FORMA T( 6 H TRIAL ,I1,1W WAS REDUNDANT) 

IREDUNHREDUN-l-l 
GO TO 4000 

IF CONTROL REACHES 4020 THEN A DUPLICATION DID OCCUR 
GO TO (9511, 9512), IPRINT 
PRINT 4021, 1 TRIAL 

format(6htrial ,ii,i6h was repetitious) 

IREPET=IREPET +1 
GO TO 4000 

AT LEAST ONE CONCEPT WAS ELIMINATED IF CONTROL REACHES 4022 
COMPARE WITH THE FOCUS 
I D I FFR=0 

IF( I ATBTI -2)4024, 4023, 4023 

IDIFFR=IDIFFR+1 

I F ( I ATBT2-2 ) 4026 , 4025 , 4026 

IDIFFR=IDIFFR+1 

! F( I ATBT3-2)4028 , 4027 , 4028 

IDIFFR=IDIFFR+1 

DID MORE THAN ONE VALUE CHANGE 
I F( I D I FFR-1 )4045 , 4029,403 1 
ONLY ONE VALUE CHANGED 
GO TO ( 9513 , 9514 ), SPRINT 
PRINT 4030, 1 TRIAL 

F 0 RMAT( 6 HTRIAL ,i1,14HWAS EFFICIENT) 

IEFFIC=IEFFIC+1 

MORE°THAN°ONE VALUE CHANGED, SO CHECK AGAINST SUCCESSIVE POSITIVE 
TRIALS 

DO 4041 l»1,ITRIAL 
I F ( I TR I L 4 ( I ) -1 ) 405 4, 4053 , 4041 
1 0 1 FFR=0 

00 NOT COMPARE A TRAIL TO ITSELF 
IF(I-ITRIAL)4032,4041,4032 , , 

IF(ITRIL1(I)-ITRIL1(ITRIAL))4033, 4034,4033 
I D I FFRs I D I FFR-l-1 . . 

IF(ITRIL2(I)-ITRIL2(ITRIAL))4035, 4036, 4035 
IDIFFR=IDIFFR+1 „ . 

IF(ITRIL3(I )-ITRIL3(ITRIAL))4037,4038,4037 
IDIFFR=IDIFFR+1 

NOW CHECK TO SEE IF ONLY ONE VALUE CHANGED 

I F( I D I FFR-1 )4046 , 4039 , 4041 

ONLY ONE VALUE CHANGED 

GO TO ( 9515 , 9516), IPRINT 

PRINT 4040, 1 TRIAL 

F0RMAT(6HTRIAL ,H,14H WAS EFFICIENT) 

IEFFIC=IEFFIC+1 
GO TO 4000 
CONTINUE 

IF CONTROL REACHES HERE ALL TRIALS DIFFERED BY MORE THAN ONE VALO 
OR ALL PRECEDING TRIALS WERE NEGATIVE 
(THEREFORE THE TRIAL WAS INEFFICIENT) 
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GO TO (9517,9518), I PRINT 
OC17 PRINT hOU2 I TRIAL 

4042 F0RMAT(6HTRIAL ,I1,16HWAS INEFFICIENT) 

9518 I INEFF=I INEFF+1 
GO TO 4000 

C NON-TRIAL EVALUATION 

C TRANSFER TO 106 INDICATES THIS WAS NOT A TRIAL, 

C I.E. IT IS EXPERIMENTER RESPONSES, RC, VERBAL 

C BEHAVIOR, VM, OR VPR. 

106 IF(IFELD1(IFIELD)-5900)108, 6037, 110 

6037 GO TO (9519, 9520), I PRINT 

9519 PRINT 6038 

6038 F0RMAT(27HSUBJECT REFUSES TO CONTINUE) 

GO TO 4001 

9520 IRC=IRC+1 

lUNNEC^I INEFF+IREDUN+IREPET 

1 1 NAPP» I CONB I 1 1 NCON-l- 1 VM-l- 1 VPR 

IEXBEH=IP1+IP2+IP3+IM1+IM2+IM3+IE1+IE2+IPW 

PUNCH 9355, A, (J( I ), 1=1 ,5), (J( I ) , 1=7,1 1 ), lEFFIC, 

1 I INEFF,IREDUN,IREPET,ICONBI,l I NCON, I VM, I VPR, I PI , I P2, 1 P3 , IM1 , 

2 IM2,IM3,IE1,IE2,IPW,IRC,IITERM,IS0LVE,IUNNEC,I INAPP, 

3 lEXBEH 
GO TO 4001 

C TRANSFER TO 108 INDICATES THIS WAS AN EXPERIMENTER 

C RESPONSE 

108 IF(IFELD1(IFIELD)-5400)130,131,132 

C TRANSFER TO 110 INDICATES THIS WAS VERBAL BEHAVIOR, 

C VM, OR VPR 

110 IVER61=0 
IVERB2<»0 
IVERB3=0 

IF(IFELD2(IFIELD)-7100)1 12,4400,4401 

4400 IVERB1=1 
GO TO 120 

4401 IVERB1=2 
GO TO 120 

C TRANSFER TO 112 INDICATES THIS WAS VM OR VERBAL BEHAVIOR (BUT NOT 
C ONE OR TWO) 

1 12 IF(IFELD2(IFIELD)-5700)1 14,4302,4304 

4302 GO TO (9521, 9522), I PRINT 

9521 PRINT 4303 

4303 F0RMAT(40HSUBJECT GIVES A VERBAL POINTING RESPONSE) 

9522 IVPR=IVPR+1 
GO TO 4000 

4304 IVERB2s2 
GO TO 120 

C TRANSFER TO 114 INDICATES THIS WAS VM OR VERBAL BEHAVIOR (BUT NOT 
C RED, ONE, OR TWO OR V.P.R.) 

1 14 IF(IFELD2(IFIEL0)-4700)1 15 , 4305,4306 

4305 IVERB2»1 
GO TO 120 

4306 GO TO (9523,9524), IPRINT 

9523 PRINT 4307 

4307 FORMAT(33HSUBJECT GIVES IRREGULAR STATEMENT) 

9524 IVM=IVM+1 
GO TO 4000 

C TRANSFER TO 115 INDICATES THIS WAS EITHER BOXES OR DIAMONDS OR ALL 

1 15 IF(IFEL02(IFIELD)-4200)9101, 4308 , 4309 
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9101 

C 

4308 

4309 
C 

120 

4207 

4208 

4209 

4210 

4211 

4212 

4213 

4214 
C 

125 

4215 

4216 

4217 

4218 

4219 

4220 

4221 

4222 
C 

4250 

4251 

4252 
C 

4253 

4256 

9525 

4257 

9526 



IS THIS VERBAL BEHAVIOR — ^ALL — THE SAME AS THE CONCEPT 
I F( I VERB4-I C0NC4)4260, 4253 , 4260 
I VERB3=1 
GO TO 120 

IVERB3-2 SECOND DIMENSION IN VERBAL BEHAVIOR 

IF(IFELD3(IFIELD)-7100)4209,4207,4208 

IVERBU1 

GO TO 125 

IVERB1=2 

?F(!fEL03(IF1ELD)-4700)4212, 4210, 421 1 

I VERB2«1 
GO TO 125 
I VERB2«2 
GO TO 125 

IF(IFELD3(IFIELD)-4200)4250,4213,4214 

IVERB3-1 
60 TO 125 
I VERB3°2 

GO TO 125 third DIMENSION IN VERBAL BEHAVIOR 

1F( 1FELD4{ 1FIELD)-^7130)4217, 4215, 4216 

IVERB1=1 

GO TO 4250 

IVERB1»2 

GO TO 4250 

|F(IFELD4(IFIELD)-4700)4220,4218,4219 
I VERB2==1 
GO TO 4250 
I VERB2b2 
GO TO 4250 

IF(IFELD4( IFIELD)-4200)4250,4221 ,4222 

IVERB3=1 

GO TO 4250 

IVERB3=2 

?S THE**VERBAL BEHAVIOR THE SAME AS THE CONCEPT 
I F ( I VERB1 - 1 CONC 1 ) 4260, jf251 , 4260 
IF(I VERB2-IC0NC2)4260,4252,4260 

yes'IPwe“reach^4S3--S^ concepts remain on the table 

IF(ILEFT2-1)4300, 4256, 4258 
ISKIP=2 

GO TO (9525,9526), I PRINT 
PRINT 42^7 

formatoohthe subject solved the problem) 

GO TO 4001 

IS0LVE=IS0LVE+1 

IUNNEC=l INEFF+IREDUN+IREPET 

MNAPPslCONBI + l INCON+IVM+IVPR 

1 I NEFF I REDON I RE PE T, I CONB 1,11 NCON , I VM, I VPR , I PI , I P2 , 1 P3 , I^MI , 

1 1 1 NEFF, I REDUN^ | , J h , I PW, I rC . 1 1 TERM, I SOLVE , 1 UNNEC , 1 1 NAPP, 

3 lEXBEH 

GO TO 4001 
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4258 GO TO (9527,9528), IPRINT 

9527 PRINT 4259 

4259 FORMAT{46HSUB.JECT GIVES CONS I STENT-BUT- INVALID STATEMENT) 

9528 ICONBUICONBI+I 
GO TO 4000 

4260 GO TO (9529,9530), IPRINT 

9529 PRINT 4261 

4261 F0RMAT(36HSUBJECT GIVES INCONSISTENT STATEMENT) 

9530 I I NCON= I I NCON+1 
GO TO 4000 

C TRANSFER TO 130 INDICATES THIS WAS AN ELICIT 

130 IF(IFEL02(IFIELD)-7100)3518,6046,6048 

6046 GO TO (9531, 9532), I PRINT 

9531 PRINT 6047 

6047 F0RMAT(30HEXPERIMENTER ELICITS STATEMENT) 

9532 IE1=IE1-t-1 
GO TO 4000 

6048 GO TO (9533, 9534), IPRINT 

9533 PRINT 6049 

6049 FORMATOOHEXPERIMENTER ELICITS STATEMENT) 

9534 IE2=:|E2-i-1 
GO TO 4000 

C TRANSFER TO 131 INDICATES THIS WAS A MOTIVATE 

131 iF(IFEL02(IFI£LD)-7200)6050,60S2,6054 

6050 GO TO (9535, 9536), IPRINT 

9535 PRINT 6051 

6051 F0RMAT(31HEXPERIMENTER MOTIVATES SLIGHTLY) 

9536 IM1=IM1+1 
GO TO 4000 

6052 GO TO (9537,9538), I PRINT 

9537 PRINT 6053 

6053 FORMAT(33HEXPERIMENTER MOTIVATES MODERATELY) 

9538 IM2=IM2-i-1 
GO TO 4000 

6054 GO TO (9539,9540), I PRINT 

9539 PRINT 6055 

6055 F0RMAT(31HEXPERIMENTER MOTIVATES STRONGLY) 

9540 IM3=°IM3-i-1 
GO TO 4000 

C TRANSFER TO 132 INDICATES THIS WAS A PROMPT OR A PUT IN WORDS—PW 

132 I F( I FELD2( I FI EL0)-7200)6056,6058 o6060 

6056 IF(IFEL02(IFIEL0)-6600)4102, 9130, 9132 

9130 GO TO (9541, 9542), IPRINT 

9541 PRINT 9131 

9131 F0RMAT(12HPUT-IN-W0R0S) 

9542 I PWs I PW-fl 
GO TO 4000 

9132 GO TO (9543,9544), I PRINT 

9543 PRINT 6057 

6057 F0RMAT(32H£XPERIMENTER GIVES SLIGHT PROMPT) 

9544 IPI-rlPUl 
GO TO 4000 

6058 GO TO (9545,9546), IPRINT 

9545 PRINT 6059 

6059 F0RMAT(34HEXPERIMENT£R GIVES MODERATE PROMPT) 

9546 IP2=IP2+1 
GO TO 4000 

6060 GO TO (9547,9548), I PRINT 
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9547 
6061 

9548 
C 

4000 

4099 



4100 



3500 

6062 



3501 

6063 



3502 

6064 



3503 

6065 



3504 

6066 



3513 

6075 



3514 

6076 



3515 

6077 



3516 

6078 



3517 

6079 



3518 

6080 



601^1 

FOwSatO^HEXPERIMENTER gives strong PROMPT) 

THE FOLLOWING FEW STATEMENTS TAKE CARE OF FIELD CHANGING 
60 TO (4100,4099), I CHANG 
IFIELO^O 

ICHANG=1 ; 

CONTINUE 

GO TO 9999 

F0RMAT(38HTHE task (columns 10-12) IS MISPUNCHEO) 

PRINT t,A,J 
ISKIP=2 
60 TO 4001 

FORMAT{57HTHE FIRST COLUMN OF THE CONCEPT (COLUMN 20) IS MISPUNCHE 
ID) 

PRINT 1,A,J 
I SK I P=2 
GO TO 4001 

F0^AT(4711PR0GRAM ERROR IN COUNTING- DIMENSIONS IN CONCEPT) 

I SK I P=2 
GO TO 4001 

F0WAT(39HTHE FOCUS (COLUMNS 26-28) IS MISPUNCHEO) 

PRINT 1,A,J 
ISKIP=2 
GO TO 4001 
PRINT 6066, 1 TRIAL 

F0RMAT(6HTRIAL ,H,15H WAS MISPUNCHEO) 

PRINT 1,A,J 
ISKIP=2 
GO TO 4001 

F0RMAT(21HERR0R ONE BEFORE 4005) 

ISKIP=2 
GO TO 4001 
PRINT 6076 

format! 12HERR0R AT 115) 

I SK I P=2 
GO TO 4001 

F0RMAT(41HERR0R THREE BEFORE 1282, OR 1283, OR 1286) 

I SK I P=2 
60 TO 4001 
PRINT 6078 , 

F0RMAT(21HERR0R AT 1305 OR 1306) 

ISKIP=2 
GO TO 4001 
PRINT 607Q 

F0RMAT(24HA TRIAL SIGN WAS MISSING) 

PRINT 1,A,J 
ISKIP=2 
60 TO 4001 

F0WAT(24HAN ELICIT WAS MISPUNCHEO) 
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PRINT 1,A,J 
ISKIPs2 
GO TO 4001 

3519 PRINT 6081 

6081 F0RMAT(21HERR0R ONE BEFORE 6000) 
ISKIPs2 
GO TO 4001 

3520 PRINT 3521 

3521 F0RMAT(13HERR0R AT 1273) 

ISKIP=2 

GO TO 4001 

4043 PRINT 4047 

4047 F0RMAT(21HERR0R FOUR AFTER 4008) 
ISKIP>2 

GO TO 4001 

4044 PRINT 4048 

4048 F0RMAT(23HERR0R AROUND OR AT 4010) 

I SK I P‘2 

GO TO 4001 

4045 PRINT 4049 

4049 FORMAT( 1 3HERR0R AT 4028) 

ISKIP>°2 

60 TO 4001 

4046 PRINT 4050 

4050 F0RMAT(13HERR0R AT 4038) 

ISKIPb2 

GO TO 4001 

4054 PRINT 4055 

4055 F0RMAT(20HERR0R ONE AFTER 4031) 

ISKIP=2 

GO TO 4001 

4102 PRINT 4103,IFIELD 

4103 F0RMAT(6HFIEL0 ,I1,15H WAS MISPUNCHEO) 
PRINT 1,A,J 

ISKIP»2 
60 TO 4001 

4300 PRINT 4301 

4301 F0RMAT(13HERR0R AT 4253) 

I3KIP=2 

GO TO 4001 

5058 PRINT 5059 

5059 FORMA T(23HC0LUMN 32 IS MISPUNCHEO) 
PRINT 1,A,J 

I SKI P-2 
GO TO 4001 
4001 GO TO 4002 
9999 CONTINUE 
END 
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Appendix II 



Intercorrelations Among Aptitude Tests 
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3717 
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3957 


23 
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24 
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1116 
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Inter correlations Among Aptitude Tests (continued) 
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Intercorrelations Among Aptitude Tests (continued) 
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latecorrelatioiis Among Aptitude Tests (continued) 
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“ NOTE: — Decimal points omitted. 

% 



Jii 



o 



Anderson 



180 



Append III 

Publications , programs , technical re^wts and theses 
prepared in ^- 7 hole or in part under Contract OE 5-10-299 
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Anderson, Richard C. Manual for presenting problems. Mimeo. 1965. 

7 pp. 

Anderson, Richard C. Note on an experiment to teach first graders a 
problem solving skill. Mimeo. 1965. 14 pp, 

Anderson, Richard C. Part vs. whole task procedures for teaching children 
a problem solving skill ® Journal of Educational Psychology . In 
press. (Also Chapter 6). 

Anderson, Richard C., Boone, Jullanne, Daniel, Jessica. Common elements 
program for the card array task. University of Illinois Training 
Research Laboratory Monograph. 1965, 1-200. 



Anderson, Richard C., Yavin, Rlvka, and Daniel, Jessica. Common elements 
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Research Laboratory Monograph , 1965, 1-200. 

Anderson, Richard C., and Yavin, Rivka. Common elements program for 

the cowboy task. University of Illinois Training Research Labprato^ 

Monograph . 1965, 1-200. 

Anderson, Richard C. , and Yavin, Rivka. Whole-training program for the 
cowboy task. University of Illinois Training Research Laboratory 
Monograph , 1965, 1-112. 

Anderson, Richard C., and Yavin, Rivka. Whole-training program for the 
pencil task. University of Illinois TraininR Research Labogatojry 
Monograph . 1965, 1-112, 

Anderson, Richard C,, and Yavin, Rivka. Whole-training program for the 

card array task. University of Illinois Training Research Laboratory 
Monograph , 1965, 

Guthrie, John T. The function of rules in learning, retention, and 
transfer. Master's thesis. University of Illinois, 1966. 

(Also in Journal of Educational Psychology , 1967, 45-49.) 



Rubovits, James J, Expository versus discovery methods in acquisition 
and transfer of principles. Master's thesis. University of 
Illinois, 19C8. 

Willis, Richard C,, and Anderson, Richard C. Dimensions of ability 

among Mat toon, Illinois fourth grade students. Mimeo, 1965. 9 pp. 
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